00000001:02000400:3.0F:1788836018.295212:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788836035.431126:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788836037.031957:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 490 MB/s 00000001:01000000:2.0:1788836037.282115:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 627 MB/s 00000001:01000000:2.0:1788836037.531457:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4195 MB/s 00000020:02000000:0.0F:1788836038.242033:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_107_gb4eb68b 00000400:02000000:0.0:1788836039.024823:0:3286:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.152@tcp [8/256/0/180] 00008000:02000000:2.0:1788836042.544799:0:3436:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788836085.197558:0:5236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788836093.649335:0:5810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836093.649360:0:5810:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788836093.649510:0:5810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000da128750 00000080:02000400:2.0:1788836093.649532:0:5810:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788836093.654690:0:5810:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788836093.654704:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788836093.654742:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003d70ea47) 00000020:00000080:2.0:1788836093.654826:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788836093.671217:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788836093.671677:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788836093.698287:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788836093.698325:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788836093.698372:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788836093.698424:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788836093.698449:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788836093.699280:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788836093.699288:0:5810:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836093.699299:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b908fda 00000020:01000004:2.0:1788836093.699307:0:5810:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788836093.699312:0:5810:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788836093.699317:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da128750 from MGS 00000020:01000004:2.0:1788836093.699321:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788836093.699330:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002a8ade28) 00000020:00000080:2.0:1788836093.699339:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788836093.699472:0:5810:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da128750 from MGS, refs=2 00080000:01000000:2.0:1788836093.699476:0:5810:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788836093.699480:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b908fe8 00000100:00100000:2.0:1788836093.699578:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788836093.699950:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788836093.699955:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1788836093.700301:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788836093.700313:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788836093.701023:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836093.701177:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788836093.701183:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788836093.701754:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788836093.701761:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788836093.702067:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788836093.702073:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788836093.702697:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836093.702701:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836093.702703:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836093.703048:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836093.703051:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836093.703052:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836093.703598:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788836093.707634:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788836093.954326:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3683 MB/s 00000001:01000000:2.0:1788836094.204459:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3247 MB/s 00000001:01000000:0.0:1788836094.454476:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 611 MB/s 00000001:01000000:0.0:1788836094.705155:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1023 MB/s 00080000:10000000:0.0:1788836094.717532:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788836094.737530:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788836094.740808:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788836094.740835:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788836094.740839:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788836094.742817:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788836094.742899:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788836094.742943:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788836094.743175:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788836094.743213:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788836094.745246:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836094.746935:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788836094.746945:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788836094.750784:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788836094.750797:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788836094.754041:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788836094.754053:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788836094.756933:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788836094.756956:0:5810:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:3.0:1788836094.756958:0:5810:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1788836094.757088:0:5825:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788836094.757120:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:3.0:1788836094.757137:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (0000000031299a36) 00000020:00000080:3.0:1788836094.757152:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788836094.757275:0:5810:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006451eab5@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836094.757526:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:3.0:1788836094.757532:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788836094.757756:0:5826:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788836094.757775:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid e8e83d0f-78a2-4253-8765-c02f0116c7a1) 00000020:00000080:3.0:1788836094.757787:0:5810:0:(genops.c:1385:class_connect()) connect: client e8e83d0f-78a2-4253-8765-c02f0116c7a1, cookie 0xcb5b7bc40b908ff6 00000100:00080000:3.0:1788836094.757798:0:5810:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836094.757802:0:5810:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import 000000006451eab5 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836094.757834:0:5810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000004aad8a7 x1875730538430592/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836094.757884:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004aad8a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538430592:0@lo:250: 00000100:00100000:3.0:1788836094.757964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788836094.758024:0:5810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS 00000020:01000004:3.0:1788836094.758041:0:5810:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788836094.758059:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788836094.758069:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a7f07c9e) 00000020:00000080:3.0:1788836094.758077:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788836094.759935:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538430592 00000100:00100000:0.0:1788836094.759947:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538430592 00000100:00100000:0.0:1788836094.759989:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836094.760005:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000052119d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875730538430592:12345-0@lo:250: 00010000:00080000:0.0:1788836094.760029:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e8e83d0f-78a2-4253-8765-c02f0116c7a1@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:0.0:1788836094.760064:0:5822:0:(genops.c:1385:class_connect()) connect: client e8e83d0f-78a2-4253-8765-c02f0116c7a1, cookie 0xcb5b7bc40b909004 00000100:00080000:0.0:1788836094.760171:0:5822:0:(import.c:65:import_set_state_nolock()) 00000000925735e5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836094.760262:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000052119d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:3301:x1875730538430592:12345-0@lo:250: Request processed in 257us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836094.760270:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836094.760722:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788836094.760731:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1788836094.760738:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788836094.760741:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788836094.760743:0:3301:0:(import.c:65:import_set_state_nolock()) 000000006451eab5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788836094.760746:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788836094.760752:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788836094.760756:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004aad8a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538430592:0@lo:250: 00000100:00100000:3.0:1788836094.769427:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836094.769616:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836094.769622:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788836094.773165:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836094.773233:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788836094.774071:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836094.774079:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788836094.774984:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836094.775180:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788836094.775186:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788836094.775896:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788836094.775903:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788836094.828128:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836094.828524:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788836094.828541:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788836094.830242:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788836094.830257:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788836094.834254:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836094.834467:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788836094.834473:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788836094.835041:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788836094.835048:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788836094.835675:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836094.835844:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788836094.835849:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788836094.836439:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788836094.836446:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788836094.836980:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836094.837153:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788836094.837333:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788836094.840617:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788836094.840630:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788836094.869759:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836094.870063:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788836094.870069:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788836094.872784:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788836094.872798:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788836094.874035:0:5810:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836094.874046:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788836094.881842:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788836094.881869:0:5810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788836094.881874:0:5810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788836094.882111:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788836094.882142:0:5810:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788836094.882146:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788836094.882147:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836094.882149:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836094.882150:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836094.882151:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836094.882152:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836094.882217:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836094.882220:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836094.882221:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836094.882222:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836094.882223:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836094.882224:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836094.882227:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788836094.882229:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836094.882230:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836094.882231:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836094.882232:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836094.882233:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836094.882235:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836094.882240:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836094.882241:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836094.882242:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836094.882243:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836094.882244:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836094.882244:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836094.882277:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788836094.882291:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000028f1988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430720:0@lo:253: 00000100:00100000:1.0:1788836094.882714:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836094.882831:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000515ea553 going to sleep for 11 seconds 00000100:00100000:3.0:1788836094.882880:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538430720 00000100:00100000:3.0:1788836094.882887:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538430720 00000100:00100000:3.0:1788836094.882968:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836094.882982:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4037c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:5810:x1875730538430720:12345-0@lo:253: 20000000:01000000:3.0:1788836094.883045:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788836094.883047:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788836094.884102:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788836094.884152:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788836094.884608:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836094.885728:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788836094.886037:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788836094.886041:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788836094.886047:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788836094.886050:0:5824:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788836094.886067:0:5824:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788836094.886503:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836094.886776:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788836094.886790:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788836094.886844:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788836094.886895:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788836094.886933:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788836094.887925:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788836094.887940:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788836094.888143:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788836094.888151:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788836094.888257:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788836094.888265:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788836094.888297:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788836094.888485:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788836094.888603:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788836094.888609:0:5824:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788836094.888623:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836094.888842:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788836094.888853:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788836094.888889:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788836094.888921:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788836094.889257:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788836094.889278:0:5824:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788836094.889730:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788836094.889742:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788836094.889793:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788836094.889831:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788836094.889866:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788836094.889877:0:5824:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788836094.890138:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788836094.890149:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788836094.890273:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788836094.890315:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788836094.890708:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788836094.890758:0:5824:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788836094.890766:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788836094.891439:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788836094.891806:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788836094.891831:0:5824:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:3.0:1788836094.891832:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788836094.891864:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788836094.891871:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788836094.891901:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788836094.891908:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1788836094.892133:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788836094.892147:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788836094.892267:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788836094.892305:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788836094.892412:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788836094.892415:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788836094.892421:0:5824:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788836094.892426:0:5824:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788836094.892920:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788836094.893131:0:5824:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788836094.906539:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788836094.906597:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788836094.906701:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788836094.906720:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788836094.906723:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788836094.906726:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788836094.906738:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788836094.906740:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788836094.906771:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788836094.906773:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788836094.908528:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788836094.909635:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788836094.909873:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788836094.909917:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788836094.909931:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788836094.909934:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788836094.910453:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788836094.910882:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788836094.910925:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788836094.911004:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1788836094.911020:0:5824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788836094.911022:0:5824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788836094.911029:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788836094.911047:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911063:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911073:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911079:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911085:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911102:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911108:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000095322de already unused, calling callback (000000009b62eea8) 00010000:00010000:3.0:1788836094.911111:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911118:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911129:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911136:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836094.911141:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000095322de/0xcb5b7bc40b90900b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836094.911229:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788836095.111281:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4037c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:5810:x1875730538430720:12345-0@lo:253: Request processed in 228293us (228561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.111295:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836095.111411:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000028f1988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430720:0@lo:253: 10000000:01000000:2.0:1788836095.111426:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788836095.111443:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836095.111445:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836095.111446:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836095.111447:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788836095.111449:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836095.111450:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836095.111451:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836095.111453:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836095.111454:0:5810:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788836095.111456:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836095.111457:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836095.111476:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000da128750 from lustre-MDT0000 10000000:01000000:2.0:1788836095.111500:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788836095.111502:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788836095.111506:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd046738000 10000000:01000000:2.0:1788836095.111510:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836095.111516:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd046738000 from 1 10000000:01000000:2.0:1788836095.111518:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788836095.111563:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836095.111573:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836095.111582:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836095.111598:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002329c866 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430848:0@lo:101: 00000100:00100000:2.0:1788836095.111632:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836095.111685:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2abdd46 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.111771:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538430848 00000100:00100000:0.0:1788836095.111778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538430848 00000100:00100000:0.0:1788836095.111818:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836095.111825:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a46e894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:5810:x1875730538430848:12345-0@lo:101: 00010000:00010000:0.0:1788836095.111836:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836095.111847:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000015a36dde/0xcb5b7bc40b909019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909012 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.111874:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015a36dde/0xcb5b7bc40b909019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.111883:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000015a36dde/0xcb5b7bc40b909019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.111890:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000015a36dde, rc 0) 00000100:00100000:0.0:1788836095.111929:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a46e894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:5810:x1875730538430848:12345-0@lo:101: Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.111935:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836095.112014:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002329c866 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430848:0@lo:101: 00010000:00010000:3.0:1788836095.112026:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.112034:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.112084:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430976:0@lo:501: 00000100:00100000:3.0:1788836095.112107:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.112126:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 000000005809eac5 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.112230:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538430976 00000100:00100000:0.0:1788836095.112234:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538430976 00000100:00100000:0.0:1788836095.112256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836095.112261:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012dd8ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:5810:x1875730538430976:12345-0@lo:501: 00000100:00100000:0.0:1788836095.112637:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012dd8ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:5810:x1875730538430976:12345-0@lo:501: Request processed in 374us (528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836095.112645:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836095.112702:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538430976:0@lo:501: 10000000:01000000:3.0:1788836095.112727:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788836095.112840:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.112849:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000005af26368/0xcb5b7bc40b909012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836095.112858:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd0497a5800 10000000:01000000:3.0:1788836095.112862:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836095.112865:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd0497a5800 10000000:01000000:3.0:1788836095.112867:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788836095.112870:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd0497a5800 from 1 10000000:01000000:3.0:1788836095.112872:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788836095.112890:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.112898:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.112904:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.112917:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431104:0@lo:101: 00000100:00100000:3.0:1788836095.112953:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.112987:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 000000005809eac5 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.113051:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431104 00000100:00100000:0.0:1788836095.113056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431104 00000100:00100000:0.0:1788836095.113089:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836095.113096:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3a58b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:5810:x1875730538431104:12345-0@lo:101: 00010000:00010000:0.0:1788836095.113105:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836095.113114:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000879a7f2c/0xcb5b7bc40b909027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909020 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113129:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000879a7f2c/0xcb5b7bc40b909027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909020 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113149:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000879a7f2c/0xcb5b7bc40b909027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909020 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113156:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000879a7f2c, rc 0) 00000100:00100000:0.0:1788836095.113186:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3a58b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+7:5810:x1875730538431104:12345-0@lo:101: Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.113192:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836095.113267:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431104:0@lo:101: 00010000:00010000:3.0:1788836095.113278:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.113285:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836095.113296:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788836095.113409:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.113416:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000095322de/0xcb5b7bc40b909020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836095.113422:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788836095.113426:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836095.113430:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd0497a5800 10000000:01000000:3.0:1788836095.113432:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788836095.113435:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788836095.113437:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836095.113450:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.113456:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.113463:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.113480:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431232:0@lo:101: 00000100:00100000:3.0:1788836095.113506:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.113521:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 000000005809eac5 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.113575:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431232 00000100:00100000:0.0:1788836095.113580:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431232 00000100:00100000:0.0:1788836095.113601:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836095.113606:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d53a44b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+7:5810:x1875730538431232:12345-0@lo:101: 00010000:00010000:0.0:1788836095.113613:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836095.113619:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf8f7b31/0xcb5b7bc40b909035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90902e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113630:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf8f7b31/0xcb5b7bc40b909035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113637:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf8f7b31/0xcb5b7bc40b909035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.113643:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf8f7b31, rc 0) 00000100:00100000:0.0:1788836095.113676:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d53a44b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+8:5810:x1875730538431232:12345-0@lo:101: Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.113682:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836095.113755:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431232:0@lo:101: 00010000:00010000:3.0:1788836095.113765:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.113771:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.113805:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431360:0@lo:501: 00000100:00100000:3.0:1788836095.113825:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.113844:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 000000005809eac5 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.113890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431360 00000100:00100000:0.0:1788836095.113894:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431360 00000100:00100000:0.0:1788836095.113912:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836095.113922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022ee583c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+8:5810:x1875730538431360:12345-0@lo:501: 00000100:00100000:0.0:1788836095.114122:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022ee583c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5810:x1875730538431360:12345-0@lo:501: Request processed in 200us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.114128:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836095.114198:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431360:0@lo:501: 00000100:00100000:3.0:1788836095.114220:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431488:0@lo:503: 00000100:00100000:3.0:1788836095.114265:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.114285:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 000000005809eac5 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.114330:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431488 00000100:00100000:0.0:1788836095.114334:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431488 00000100:00100000:0.0:1788836095.114381:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836095.114386:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9888fab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5810:x1875730538431488:12345-0@lo:503: 00000100:00100000:0.0:1788836095.114513:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9888fab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5810:x1875730538431488:12345-0@lo:503: Request processed in 127us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.114519:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836095.114598:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431488:0@lo:503: 00000100:00100000:3.0:1788836095.115142:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5852:1875730538431616:0@lo:502: 00000100:00100000:3.0:1788836095.115178:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.115250:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5321d88 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.115290:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431616 00000100:00100000:0.0:1788836095.115294:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431616 00000100:00100000:0.0:1788836095.115386:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836095.115393:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49c0c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5852:x1875730538431616:12345-0@lo:502: 00000100:00100000:0.0:1788836095.115538:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49c0c3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5852:x1875730538431616:12345-0@lo:502: Request processed in 146us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836095.115546:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836095.115610:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5852:1875730538431616:0@lo:502: 00000020:01000000:3.0:1788836095.115631:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836095.115640:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.115647:0:5852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836095.115651:0:5852:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788836095.115654:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836095.115665:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000199904fd) 00000020:00000080:3.0:1788836095.115680:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788836095.115686:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788836095.115772:0:5852:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788836095.115778:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b909043 00000020:00000080:3.0:1788836095.116049:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788836095.116054:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836095.116058:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.116059:0:5852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836095.116062:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836095.116065:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.116066:0:5852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788836095.116069:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836095.116075:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000abf1047c) 00000020:00000080:3.0:1788836095.116085:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788836095.116089:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788836095.116091:0:5852:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788836095.116093:0:5852:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788836095.116099:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836095.116140:0:5852:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da128750 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788836095.116160:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000546e185f) 00000020:00000080:3.0:1788836095.116168:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788836095.116216:0:5852:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788836095.116221:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b909058 00000020:00000080:3.0:1788836095.116303:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788836095.116309:0:5852:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788836095.116313:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcb5b7bc40b90905f 00080000:01000000:3.0:1788836095.116317:0:5852:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788836095.116320:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b909066 00080000:10000000:3.0:1788836095.116723:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788836095.116950:0:5852:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788836095.121926:0:5852:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788836095.178255:0:5852:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788836095.178576:0:5852:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788836095.181211:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788836095.181513:0:5852:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788836095.231219:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c7631d9f) 00000020:00000080:0.0:1788836095.231242:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788836095.231310:0:5852:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788836095.231316:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b909074 00000020:00000080:2.0:1788836095.235492:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788836095.236604:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836095.279413:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836095.302414:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.334433:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.374320:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788836095.418640:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788836095.473141:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcb5b7bc40b90907b 00000020:00000080:3.0:1788836095.473516:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788836095.473528:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836095.473533:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.473535:0:5852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788836095.473537:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836095.473543:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.473544:0:5852:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788836095.473547:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788836095.473583:0:5852:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788836095.473596:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836095.473600:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.473601:0:5852:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788836095.473603:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836095.473606:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836095.473607:0:5852:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788836095.473609:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788836095.473610:0:5852:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788836095.473650:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5852:1875730538431744:0@lo:502: 00000100:00100000:3.0:1788836095.473728:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.473787:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5321d88 going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.473856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431744 00000100:00100000:1.0:1788836095.473863:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431744 00000100:00100000:1.0:1788836095.473918:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836095.473926:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7bee294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5852:x1875730538431744:12345-0@lo:502: 00000100:00100000:1.0:1788836095.474239:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7bee294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5852:x1875730538431744:12345-0@lo:502: Request processed in 313us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836095.474247:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836095.474299:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b99c038b pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5852:1875730538431744:0@lo:502: 00000020:01000000:1.0:1788836095.474326:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836095.474366:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836095.474369:0:5852:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788836095.474372:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788836095.474800:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788836095.474817:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836095.474838:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.474849:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000453fcef2/0xcb5b7bc40b90902e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836095.474870:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd0497a5800 from 1 10000000:01000000:3.0:1788836095.474873:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836095.474898:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.474906:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.474914:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.474929:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f5f525d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431872:0@lo:101: 00000100:00100000:3.0:1788836095.474963:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.475005:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fed9e70b going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.475102:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538431872 00000100:00100000:1.0:1788836095.475108:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538431872 00000100:00100000:1.0:1788836095.475145:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836095.475152:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5b18ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:5810:x1875730538431872:12345-0@lo:101: 00010000:00010000:1.0:1788836095.475171:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836095.475185:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909082 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.475206:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.475215:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.475224:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b16aeb04, rc 0) 00000100:00100000:1.0:1788836095.475305:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5b18ecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:5810:x1875730538431872:12345-0@lo:101: Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836095.475312:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836095.475637:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f5f525d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538431872:0@lo:101: 00010000:00010000:0.0:1788836095.475649:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.475664:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836095.476230:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fe2b46b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432000:0@lo:256: 00000100:00100000:0.0:1788836095.476277:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.476762:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432000 00000100:00100000:3.0:1788836095.476771:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432000 00000100:00100000:3.0:1788836095.476813:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836095.476820:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e60ac89c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:5810:x1875730538432000:12345-0@lo:256: 20000000:01000000:3.0:1788836095.476839:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788836095.476844:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788836095.477141:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e60ac89c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:5810:x1875730538432000:12345-0@lo:256: Request processed in 321us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.477149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836095.477213:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b636da going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.477233:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fe2b46b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432000:0@lo:256: 10000000:01000000:1.0:1788836095.480861:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836095.480881:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.480895:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836095.480903:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd0497a5800 from 1 10000000:01000000:1.0:1788836095.480906:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836095.480950:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.480957:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.480978:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836095.481010:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a57d1a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432128:0@lo:101: 00000100:00100000:1.0:1788836095.481076:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836095.481121:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4484f76 going to sleep for 11 seconds 00000100:00100000:3.0:1788836095.481208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432128 00000100:00100000:3.0:1788836095.481216:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432128 00000100:00100000:3.0:1788836095.481264:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836095.481272:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097ea4189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:5810:x1875730538432128:12345-0@lo:101: 00010000:00010000:3.0:1788836095.481285:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836095.481303:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909090 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.481325:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.481334:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.481360:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f11fb6a2, rc 0) 00000100:00100000:3.0:1788836095.481401:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097ea4189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432128:12345-0@lo:101: Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.481408:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836095.485269:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a57d1a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432128:0@lo:101: 00010000:00010000:1.0:1788836095.485297:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.485309:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836095.485660:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a57d1a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432256:0@lo:501: 00000100:00100000:1.0:1788836095.485724:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836095.485773:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4484f76 going to sleep for 11 seconds 00000100:00100000:3.0:1788836095.485900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432256 00000100:00100000:3.0:1788836095.485907:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432256 00000100:00100000:3.0:1788836095.485955:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836095.485963:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca19d95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432256:12345-0@lo:501: 00000100:00100000:3.0:1788836095.486732:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca19d95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432256:12345-0@lo:501: Request processed in 767us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.486740:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836095.487086:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a57d1a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432256:0@lo:501: 00000100:00100000:2.0:1788836095.487188:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000731f2fc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432384:0@lo:503: 00000100:00100000:2.0:1788836095.487239:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836095.487297:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b198cb2a going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.487337:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432384 00000100:00100000:1.0:1788836095.487446:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432384 00000100:00100000:1.0:1788836095.487587:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836095.487596:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000557b2efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432384:12345-0@lo:503: 00000040:00080000:1.0:1788836095.487651:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836095.487704:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000557b2efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432384:12345-0@lo:503: Request processed in 110us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836095.487712:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836095.487783:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000731f2fc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432384:0@lo:503: 00000040:00080000:2.0:1788836095.488909:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788836095.489086:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788836095.489109:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836095.489133:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.489144:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836095.489188:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836095.489191:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd0497a5800 10000000:01000000:0.0:1788836095.489194:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd0497a5800 10000000:01000000:0.0:1788836095.489198:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836095.489203:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd0497a5800 from 1 10000000:01000000:0.0:1788836095.489205:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836095.489236:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.489244:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.489251:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836095.489269:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432512:0@lo:101: 00000100:00100000:0.0:1788836095.489328:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836095.489743:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b636da going to sleep for 11 seconds 00000100:00100000:3.0:1788836095.489775:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432512 00000100:00100000:3.0:1788836095.489782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432512 00000100:00100000:3.0:1788836095.489816:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836095.489824:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000420dde9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538432512:12345-0@lo:101: 00010000:00010000:3.0:1788836095.489835:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836095.489847:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000faf70cae/0xcb5b7bc40b9090a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90909e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.489868:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000faf70cae/0xcb5b7bc40b9090a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.489885:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000faf70cae/0xcb5b7bc40b9090a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.489893:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000faf70cae, rc 0) 00000100:00100000:3.0:1788836095.489967:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000420dde9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538432512:12345-0@lo:101: Request processed in 144us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.489973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836095.490082:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432512:0@lo:101: 00010000:00010000:0.0:1788836095.490095:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.490103:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836095.490204:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432640:0@lo:501: 00000100:00100000:0.0:1788836095.490231:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836095.490251:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b636da going to sleep for 11 seconds 00000100:00100000:3.0:1788836095.490290:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432640 00000100:00100000:3.0:1788836095.490295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432640 00000100:00100000:3.0:1788836095.490322:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836095.490328:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e83335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538432640:12345-0@lo:501: 00000100:00100000:3.0:1788836095.490866:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e83335 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538432640:12345-0@lo:501: Request processed in 537us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.490874:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836095.490947:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432640:0@lo:501: 00000100:00100000:0.0:1788836095.490976:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432768:0@lo:503: 00000100:00100000:0.0:1788836095.491023:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836095.491052:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009b636da going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.491098:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432768 00000100:00100000:1.0:1788836095.491102:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432768 00000100:00100000:1.0:1788836095.491139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836095.491151:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089b5919b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538432768:12345-0@lo:503: 00000100:00100000:1.0:1788836095.491500:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089b5919b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538432768:12345-0@lo:503: Request processed in 350us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836095.491507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836095.491776:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538432768:0@lo:503: 00000100:00100000:0.0:1788836095.492180:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5857:1875730538432896:0@lo:502: 00000100:00100000:0.0:1788836095.492222:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836095.492253:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066f75609 going to sleep for 11 seconds 00000100:00100000:1.0:1788836095.492375:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538432896 00000100:00100000:1.0:1788836095.492381:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538432896 00000100:00100000:1.0:1788836095.492412:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836095.492419:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007856cdc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5857:x1875730538432896:12345-0@lo:502: 00000100:00100000:1.0:1788836095.492846:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007856cdc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5857:x1875730538432896:12345-0@lo:502: Request processed in 427us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836095.492854:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836095.492939:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8d10f5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5857:1875730538432896:0@lo:502: 00000020:01000004:0.0:1788836095.493009:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788836095.493023:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ca5c1103) 00000020:00000080:0.0:1788836095.493040:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788836095.493110:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000da128750 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836095.493114:0:5857:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000da128750 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836095.493235:0:5857:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000da128750 4 00010000:00080000:0.0:1788836095.493268:0:5857:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000061b506c5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836095.496374:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788836095.496721:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788836095.496762:0:5857:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836095.496774:0:5857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcb5b7bc40b9090b3 00000100:00080000:3.0:1788836095.496784:0:5857:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836095.496789:0:5857:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061b506c5 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836095.496820:0:5857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ad735ed9 x1875730538433024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836095.496844:0:5857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788836095.497048:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad735ed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538433024:0@lo:38: 00000100:00100000:0.0:1788836095.497116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.497284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433024 00000100:00100000:3.0:1788836095.497292:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433024 00000100:00100000:3.0:1788836095.497324:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836095.497330:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d10f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538433024:12345-0@lo:38: 00000100:00100000:3.0:1788836095.497413:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d10f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538433024:12345-0@lo:38: Request processed in 81us (297us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788836095.497421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836095.497463:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836095.499304:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000061b506c5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836095.499311:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788836095.499316:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad735ed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538433024:0@lo:38: 00000100:00100000:3.0:1788836095.499442:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad735ed9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5857:1875730538433152:0@lo:502: 00000100:00100000:3.0:1788836095.499564:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.499598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433152 00000100:00100000:3.0:1788836095.499603:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433152 00000100:00100000:3.0:1788836095.499860:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836095.499869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f98bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5857:x1875730538433152:12345-0@lo:502: 00000100:00100000:3.0:1788836095.500075:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f98bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5857:x1875730538433152:12345-0@lo:502: Request processed in 207us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.500083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836095.500417:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055fb7636 going to sleep for 11 seconds 00000100:00100000:2.0:1788836095.500435:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad735ed9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5857:1875730538433152:0@lo:502: 00000040:00080000:2.0:1788836095.500458:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788836095.500718:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788836095.500736:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836095.500754:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836095.500764:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000ee0e1db7/0xcb5b7bc40b90909e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836095.500803:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836095.500805:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836095.500806:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836095.500807:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836095.500809:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836095.500810:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836095.500811:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836095.500812:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836095.500814:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836095.500815:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836095.500816:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836095.500817:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836095.500821:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788836095.500828:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836095.500830:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836095.500830:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836095.500831:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836095.500832:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836095.500833:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836095.500834:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836095.500835:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836095.500835:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836095.500836:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836095.500837:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836095.500838:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836095.500854:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788836095.500865:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9cb7fd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538433280:0@lo:253: 00000100:00100000:1.0:1788836095.500903:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836095.501065:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set 00000000813214a2 going to sleep for 11 seconds 00000100:00100000:0.0:1788836095.503568:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433280 00000100:00100000:0.0:1788836095.503581:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433280 00000100:00100000:0.0:1788836095.503643:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836095.503652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f37e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5810:x1875730538433280:12345-0@lo:253: 20000000:01000000:0.0:1788836095.503681:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788836095.503692:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836095.530894:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836095.530942:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788836095.531019:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836095.531024:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836095.531043:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.531063:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.531071:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.531111:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.531138:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 12 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.531152:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6104ea0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538433408:0@lo:104: 00000100:00100000:3.0:1788836095.531214:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.531266:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee6f0b6f going to sleep for 11 seconds 00000100:00100000:2.0:1788836095.531275:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433408 00000100:00100000:2.0:1788836095.531283:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433408 00000100:00100000:2.0:1788836095.531328:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836095.531336:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed64c8e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538433408:12345-0@lo:104: 00010000:00010000:2.0:1788836095.531375:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836095.531435:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836095.531440:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed64c8e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538433408:12345-0@lo:104: Request processed in 105us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.531445:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6104ea0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538433408:0@lo:104: 00000100:00100000:2.0:1788836095.531446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788836095.531460:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531503:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836095.531508:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531586:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2a89190 already unused, calling callback (000000007c048483) 10000000:00010000:0.0:1788836095.531590:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531597:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836095.531603:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836095.531609:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836095.531635:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531641:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836095.531677:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531683:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000f2a89190/0xcb5b7bc40b909082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909089 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836095.531699:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836095.531701:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836095.531702:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836095.531797:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbbc73fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538433536:0@lo:103: 00000100:00100000:1.0:1788836095.531828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836095.531867:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433536 00000100:00100000:3.0:1788836095.531871:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433536 00010000:00010000:3.0:1788836095.531889:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 13 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836095.531956:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836095.531962:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004fe3ddb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3303:x1875730538433536:12345-0@lo:103: 00010000:00010000:3.0:1788836095.531972:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836095.531976:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 13 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.531985:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 13 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532008:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b16aeb04/0xcb5b7bc40b909089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909082 expref: 13 pid: 5823 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532019:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532031:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836095.532041:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001017568s 00010000:00010000:3.0:1788836095.532044:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532050:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532055:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532059:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532064:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c97b7e3 already unused, calling callback (000000009b62eea8) 00010000:00010000:3.0:1788836095.532066:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532072:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532084:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532092:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836095.532126:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004fe3ddb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3303:x1875730538433536:12345-0@lo:103: Request processed in 165us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.532133:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788836095.532408:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836095.532421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c97b7e3/0xcb5b7bc40b9090ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836095.532933:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbbc73fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538433536:0@lo:103: 00000100:00100000:3.0:1788836095.544053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f37e81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5810:x1875730538433280:12345-0@lo:253: Request processed in 40397us (43143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836095.544068:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836095.544226:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9cb7fd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5810:1875730538433280:0@lo:253: 10000000:01000000:1.0:1788836095.544240:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788836095.544243:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836095.544245:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836095.544246:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836095.544247:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836095.544248:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836095.544250:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836095.544251:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836095.544252:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836095.544254:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788836095.544255:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788836095.544257:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836095.544258:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788836095.544273:0:5810:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788836095.555389:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.555903:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836095.556274:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.556654:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836095.556883:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.557227:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836095.558254:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.558606:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836095.558822:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.559166:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836095.559432:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836095.559677:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788836095.600005:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788836095.626334:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788836095.626819:0:5863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788836095.627532:0:5862:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788836095.627537:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788836095.629450:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788836095.629671:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788836095.630093:0:5810:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788836095.630101:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788836095.630251:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836095.631302:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788836095.633383:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788836095.633441:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788836095.633687:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788836095.633863:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788836095.636400:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788836095.636551:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788836095.636682:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788836095.636827:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788836095.636947:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788836095.637094:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788836095.637234:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788836095.637411:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788836095.637541:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788836095.637701:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788836095.637853:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788836095.638141:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788836095.638274:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788836095.638462:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788836095.638618:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788836095.638785:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788836095.639079:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788836095.639230:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788836095.639414:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788836095.639551:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788836095.639681:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788836095.639854:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788836095.640164:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788836095.640603:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788836095.640743:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788836095.640888:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788836095.641028:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788836095.641177:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788836095.641321:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788836095.641596:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788836095.641756:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788836095.641910:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788836095.642116:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788836095.666197:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788836095.735374:0:5810:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788836095.735410:0:5810:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7ccc1c67988 00100000:10000000:3.0:1788836095.735419:0:5810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788836095.738308:0:5810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836095.738323:0:5810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836095.738336:0:5810:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788836095.738377:0:5810:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788836095.762440:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836095.794827:0:5863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788836095.794902:0:5863:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788836095.794907:0:5863:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788836096.785166:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836097.810173:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836098.832551:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836099.161016:0:6106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836099.859976:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836100.880515:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836100.944779:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836100.944790:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788836100.944793:0:36:0:(import.c:65:import_set_state_nolock()) 0000000061b506c5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836100.944805:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000061b506c5 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836100.945032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c6104ea0 x1875730538433792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836100.945126:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6104ea0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538433792:0@lo:38: 00000100:00100000:3.0:1788836100.945128:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9cb7fd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538433664:0@lo:400: 00000100:00100000:3.0:1788836100.945383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836100.945690:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433664 00000100:00100000:0.0:1788836100.945699:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433664 00000100:00100000:0.0:1788836100.945837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836100.945846:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005df1aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3304:x1875730538433664:12345-0@lo:400: 00000100:00100000:0.0:1788836100.945909:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005df1aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3304:x1875730538433664:12345-0@lo:400: Request processed in 64us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836100.945916:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836100.946059:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9cb7fd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538433664:0@lo:400: 00000100:00100000:1.0:1788836100.953743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836100.953910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433792 00000100:00100000:0.0:1788836100.953919:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433792 00000100:00100000:0.0:1788836100.954011:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836100.954018:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cee48019 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875730538433792:12345-0@lo:38: 00010000:00080000:0.0:1788836100.954045:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1788836100.954094:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcb5b7bc40b9090c1 00000004:00100000:0.0:1788836100.954138:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836100.954246:0:5831:0:(import.c:65:import_set_state_nolock()) 000000001ae3b7f2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836100.954305:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cee48019 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875730538433792:12345-0@lo:38: Request processed in 286us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836100.954312:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836100.954386:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c6104ea0 x1875730538433792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836100.954402:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788836100.954425:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788836100.954429:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836100.954432:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000061b506c5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836100.954438:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6104ea0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538433792:0@lo:38: 00010000:00010000:2.0:1788836101.906485:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836102.930201:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836103.425075:0:6307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb86dbc20 20000000:00000080:0.0:1788836103.425091:0:6307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd0454a5c00 uarg=0000000000000000 20000000:01000000:0.0:1788836103.425120:0:6307:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788836103.425126:0:6307:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788836103.425131:0:6307:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788836103.425313:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788836103.425325:0:6307:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788836103.437305:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836103.437931:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788836103.438103:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788836103.438165:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788836103.438184:0:6307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836103.438202:0:6307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836103.438220:0:6307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836103.438235:0:6307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836103.438271:0:6307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836103.438286:0:6307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 10 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836103.438299:0:6307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009ad8af3b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1875730538433920:0@lo:104: 00000100:00100000:0.0:1788836103.438584:0:6307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836103.438637:0:6307:0:(client.c:2715:ptlrpc_set_wait()) set 000000009be48742 going to sleep for 11 seconds 00000100:00100000:2.0:1788836103.438990:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538433920 00000100:00100000:2.0:1788836103.438998:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538433920 00000100:00100000:2.0:1788836103.439054:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836103.439063:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3505c02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:6307:x1875730538433920:12345-0@lo:104: 00010000:00010000:2.0:1788836103.439075:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439140:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836103.439145:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3505c02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:6307:x1875730538433920:12345-0@lo:104: Request processed in 84us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836103.439151:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788836103.439170:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836103.439175:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439183:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bccac31a already unused, calling callback (000000007c048483) 10000000:00010000:2.0:1788836103.439186:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439193:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836103.439199:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836103.439205:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836103.439233:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439252:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836103.439270:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439276:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000bccac31a/0xcb5b7bc40b909090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909097 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439292:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836103.439294:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836103.439296:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836103.439307:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836103.439310:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd0497a5800 from 3 10000000:01000000:2.0:1788836103.439313:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836103.439331:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439338:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439373:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836103.439389:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0233589 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434176:0@lo:101: 00000100:00100000:2.0:1788836103.439423:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836103.439568:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b33e230d going to sleep for 11 seconds 00000100:00100000:2.0:1788836103.439584:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000731f2fc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538434048:0@lo:103: 00000100:00100000:2.0:1788836103.439610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836103.439645:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434176 00000100:00100000:2.0:1788836103.439650:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434176 00000100:00100000:2.0:1788836103.439684:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836103.439690:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006268adde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:5826:x1875730538434176:12345-0@lo:101: 00010000:00010000:2.0:1788836103.439702:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836103.439714:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cba60b55/0xcb5b7bc40b9090d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9090cf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439732:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cba60b55/0xcb5b7bc40b9090d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439742:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cba60b55/0xcb5b7bc40b9090d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439749:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cba60b55, rc 0) 00000100:00100000:2.0:1788836103.439778:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006268adde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538434176:12345-0@lo:101: Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836103.439784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836103.439814:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434048 00000100:00100000:2.0:1788836103.439818:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434048 00010000:00010000:2.0:1788836103.439831:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 12 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836103.439850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836103.439855:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e0492da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3305:x1875730538434048:12345-0@lo:103: 00010000:00010000:2.0:1788836103.439862:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836103.439865:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 12 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439874:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 12 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439895:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439901:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439911:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439917:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439922:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439927:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439932:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1b3afae already unused, calling callback (000000009b62eea8) 00010000:00010000:2.0:1788836103.439945:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439952:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439959:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836103.439967:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836103.439994:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e0492da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3305:x1875730538434048:12345-0@lo:103: Request processed in 139us (383us total) trans 0 rc 0/0 00010000:00010000:1.0:1788836103.440237:0:6307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f11fb6a2/0xcb5b7bc40b909097 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909090 expref: 12 pid: 5824 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836103.440249:0:6307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009ad8af3b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1875730538433920:0@lo:104: 00010000:00010000:1.0:1788836103.440270:0:6307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.440277:0:6307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.440282:0:6307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.440287:0:6307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1b3afae/0xcb5b7bc40b9090c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836103.441115:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0233589 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434176:0@lo:101: 00010000:00010000:1.0:1788836103.441134:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441148:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836103.441202:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434304:0@lo:256: 00000100:00100000:1.0:1788836103.441249:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.441281:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7db299e going to sleep for 11 seconds 00000100:00100000:1.0:1788836103.441298:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434304 00000100:00100000:1.0:1788836103.441302:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434304 00000100:00100000:1.0:1788836103.441335:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836103.441370:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c99c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538434304:12345-0@lo:256: 20000000:01000000:1.0:1788836103.441389:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788836103.441405:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788836103.441409:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788836103.441482:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c99c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538434304:12345-0@lo:256: Request processed in 142us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836103.441490:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836103.441523:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434304:0@lo:256: 10000000:01000000:1.0:1788836103.441559:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836103.441565:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441572:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000abb46ce1/0xcb5b7bc40b9090cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836103.441581:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836103.441583:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd0497a5800 from 1 10000000:01000000:1.0:1788836103.441586:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836103.441611:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000644f418f/0xcb5b7bc40b9090dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441619:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000644f418f/0xcb5b7bc40b9090dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441627:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000644f418f/0xcb5b7bc40b9090dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836103.441638:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434432:0@lo:101: 00000100:00100000:1.0:1788836103.441661:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.441679:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7db299e going to sleep for 11 seconds 00000100:00100000:1.0:1788836103.441689:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434432 00000100:00100000:1.0:1788836103.441692:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434432 00000100:00100000:1.0:1788836103.441712:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836103.441718:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a4c4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538434432:12345-0@lo:101: 00010000:00010000:1.0:1788836103.441726:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836103.441736:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ebbb027/0xcb5b7bc40b9090e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9090dd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441751:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ebbb027/0xcb5b7bc40b9090e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441759:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ebbb027/0xcb5b7bc40b9090e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441767:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ebbb027, rc 0) 00000100:00100000:1.0:1788836103.441792:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a4c4a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538434432:12345-0@lo:101: Request processed in 74us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836103.441797:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836103.441831:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434432:0@lo:101: 00010000:00010000:1.0:1788836103.441840:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000644f418f/0xcb5b7bc40b9090dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.441846:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000644f418f/0xcb5b7bc40b9090dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836103.441886:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434560:0@lo:501: 00000100:00100000:1.0:1788836103.441909:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.441921:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000598b1682 going to sleep for 11 seconds 00000100:00100000:1.0:1788836103.441931:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434560 00000100:00100000:1.0:1788836103.441948:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434560 00000100:00100000:1.0:1788836103.441970:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836103.441975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000448e4f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538434560:12345-0@lo:501: 00000100:00100000:1.0:1788836103.442204:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000448e4f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538434560:12345-0@lo:501: Request processed in 228us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836103.442211:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836103.442240:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434560:0@lo:501: 00000100:00100000:1.0:1788836103.442264:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434688:0@lo:503: 00000100:00100000:1.0:1788836103.442297:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.442308:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000598b1682 going to sleep for 11 seconds 00000100:00100000:1.0:1788836103.442319:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434688 00000100:00100000:1.0:1788836103.442322:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434688 00000100:00100000:1.0:1788836103.442369:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836103.442376:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024260c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538434688:12345-0@lo:503: 00000100:00100000:1.0:1788836103.442491:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024260c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538434688:12345-0@lo:503: Request processed in 116us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836103.442505:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836103.442538:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538434688:0@lo:503: 00000100:00100000:1.0:1788836103.442693:0:6308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6308:1875730538434816:0@lo:502: 00000100:00100000:1.0:1788836103.442724:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.442742:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434816 00000100:00100000:1.0:1788836103.442745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434816 00000100:00100000:1.0:1788836103.442765:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836103.442771:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40eaaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6308:x1875730538434816:12345-0@lo:502: 00000100:00100000:1.0:1788836103.442865:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40eaaa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6308:x1875730538434816:12345-0@lo:502: Request processed in 94us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836103.442871:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836103.442904:0:6308:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056caf8be going to sleep for 11 seconds 00000100:00100000:1.0:1788836103.442916:0:6308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d9b09c pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6308:1875730538434816:0@lo:502: 00000100:00100000:2.0:1788836103.443192:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836103.443243:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000731f2fc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538434048:0@lo:103: 00000020:01000000:1.0:1788836103.447035:0:6308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836103.447067:0:6308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836103.447070:0:6308:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788836103.447080:0:6308:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd0497a5800 00000020:00000080:1.0:1788836103.447083:0:6308:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788836103.447151:0:6308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6308:1875730538434944:0@lo:502: 00000100:00100000:1.0:1788836103.447230:0:6308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836103.447312:0:6308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046587b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836103.447803:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538434944 00000100:00100000:2.0:1788836103.447812:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538434944 00000100:00100000:2.0:1788836103.447891:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836103.447901:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6308:x1875730538434944:12345-0@lo:502: 00000100:00100000:2.0:1788836103.448137:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6308:x1875730538434944:12345-0@lo:502: Request processed in 237us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836103.448145:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836103.448232:0:6308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6308:1875730538434944:0@lo:502: 00000020:01000000:3.0:1788836103.448259:0:6308:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836103.448265:0:6308:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836103.448272:0:6308:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836103.448275:0:6308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788836103.448920:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788836103.448948:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836103.448958:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.448981:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836103.952697:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836104.978620:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836106.000724:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836106.064774:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538435072:0@lo:400: 00000100:00100000:2.0:1788836106.064852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836106.064917:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836106.064934:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538435200:0@lo:400: 00000100:00100000:2.0:1788836106.064968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836106.065037:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435072 00000100:00100000:1.0:1788836106.065045:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435072 00000100:00100000:1.0:1788836106.065106:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836106.065116:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3302:x1875730538435072:12345-0@lo:400: 00000100:00100000:1.0:1788836106.065171:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3302:x1875730538435072:12345-0@lo:400: Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836106.065181:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788836106.065247:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538435072:0@lo:400: 00000100:00100000:0.0:1788836106.067426:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435200 00000100:00100000:0.0:1788836106.067439:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435200 00000100:00100000:0.0:1788836106.067525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836106.067536:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538435200:12345-0@lo:400: 00000100:00100000:0.0:1788836106.067621:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538435200:12345-0@lo:400: Request processed in 87us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836106.067628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788836106.067715:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd078fb7800 x1875730538435200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836106.067730:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538435200:0@lo:400: 00010000:00010000:3.0:1788836107.025616:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836108.051105:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788836108.237547:0:6678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788836108.237551:0:6678:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788836108.237657:0:6678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd078fee000 00000020:01000004:1.0:1788836108.237688:0:6678:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788836108.237701:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788836108.237725:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd07b2319b8) 00000020:00000080:1.0:1788836108.237742:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788836108.250562:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788836108.250928:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788836108.286333:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788836108.292005:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788836108.292038:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788836108.292095:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788836108.292122:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788836108.294446:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788836108.294458:0:6678:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836108.294468:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b9090f2 00000020:01000004:3.0:1788836108.294476:0:6678:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788836108.294495:0:6678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836108.294498:0:6678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836108.294503:0:6678:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788836108.294507:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788836108.294519:0:6678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd07b2b19b8) 00000020:00000080:3.0:1788836108.294529:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788836108.295735:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836108.295921:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836108.295926:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788836108.297388:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836108.297398:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788836108.298568:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788836108.298577:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788836108.304932:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836108.311447:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788836108.311456:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788836108.312850:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836108.312860:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788836108.348632:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836108.348996:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788836108.349004:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788836108.352685:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836108.352700:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788836108.353440:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788836108.353455:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788836108.356853:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836108.357062:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788836108.357068:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788836108.358545:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836108.358556:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788836108.448295:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836108.448512:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836108.448519:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788836108.453485:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836108.453506:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788836108.465167:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788836108.465194:0:6678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788836108.465200:0:6678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788836108.494248:0:6678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836108.494286:0:6678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788836108.494291:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836108.494293:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836108.494294:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836108.494295:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836108.494296:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836108.494298:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836108.494300:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836108.494301:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836108.494302:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836108.494304:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836108.494305:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836108.494309:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788836108.494311:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836108.494312:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836108.494313:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836108.494314:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836108.494315:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836108.494316:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836108.494317:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836108.494318:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836108.494319:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836108.494320:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836108.494321:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836108.496293:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788836108.496322:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538435328:0@lo:253: 00000100:00100000:2.0:1788836108.496462:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.496612:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435328 00000100:00100000:1.0:1788836108.496620:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435328 00000100:00100000:1.0:1788836108.496677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836108.496686:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538435328:12345-0@lo:253: 20000000:01000000:1.0:1788836108.496714:0:5823:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788836108.496718:0:5823:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788836108.496723:0:5823:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788836108.496726:0:5823:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788836108.497703:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836108.497930:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788836108.497943:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788836108.497983:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788836108.497991:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788836108.498023:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788836108.498067:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788836108.498447:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788836108.498464:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1788836108.498466:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788836108.498493:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788836108.498499:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788836108.498537:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788836108.498544:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788836108.498570:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788836108.498578:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788836108.498602:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788836108.498649:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788836108.499340:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788836108.499392:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1788836108.499399:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788836108.499435:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788836108.499442:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788836108.499467:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788836108.499473:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788836108.499513:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788836108.499521:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788836108.499549:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788836108.499577:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788836108.499591:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788836108.499594:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788836108.499598:0:5823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788836108.499611:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788836108.499614:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788836108.499646:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788836108.499648:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:2.0:1788836108.499873:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6240 going to sleep for 11 seconds 20000000:01000000:2.0:1788836108.500284:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788836108.500333:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788836108.500426:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788836108.501058:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788836108.501407:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788836108.501451:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788836108.501465:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788836108.501467:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788836108.503113:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788836108.503634:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788836108.503684:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788836108.503934:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788836108.503950:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788836108.503952:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788836108.504892:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788836108.505128:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788836108.505182:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788836108.505456:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788836108.505491:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788836108.505542:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788836108.505559:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788836108.505561:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788836108.505569:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788836108.505589:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505607:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505615:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505622:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505636:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505673:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505687:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 12 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.505701:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435456:0@lo:104: 00000100:00100000:1.0:1788836108.505762:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836108.505819:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.505827:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 12 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.505836:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435584:0@lo:104: 00000100:00100000:0.0:1788836108.505847:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435456 00000100:00100000:0.0:1788836108.505853:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435456 00000100:00100000:1.0:1788836108.505856:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836108.505883:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.505883:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435584 00000100:00100000:0.0:1788836108.505886:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435584 00010000:00010000:1.0:1788836108.505891:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 12 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.505898:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836108.505899:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435712:0@lo:104: 00000100:00100000:0.0:1788836108.505923:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538435456:12345-0@lo:104: 00010000:00010000:0.0:1788836108.505935:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.505981:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836108.505987:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538435456:12345-0@lo:104: Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.505993:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836108.506008:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836108.506013:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538435584:12345-0@lo:104: 00010000:00010000:0.0:1788836108.506020:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506047:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836108.506051:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538435584:12345-0@lo:104: Request processed in 39us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.506057:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788836108.506071:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836108.506077:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506089:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836108.506104:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506112:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836108.506119:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836108.506125:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836108.506209:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506216:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788836108.506262:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538435840:0@lo:103: 00000100:00100000:1.0:1788836108.506265:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.506281:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05146a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.506288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.506299:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435456:0@lo:104: 00010000:00010000:0.0:1788836108.506329:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506337:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b90909e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090a5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506361:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836108.506364:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506370:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836108.506373:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.506390:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836108.506397:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836108.506402:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836108.506417:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.506422:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435584:0@lo:104: 00010000:00010000:0.0:1788836108.506423:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788836108.506452:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435712 00000100:00100000:1.0:1788836108.506456:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435712 00000100:00100000:1.0:1788836108.506488:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836108.506494:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538435712:12345-0@lo:104: 00010000:00010000:1.0:1788836108.506502:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506535:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836108.506540:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538435712:12345-0@lo:104: Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836108.506545:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788836108.506565:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788836108.506590:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836108.506598:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538435968:0@lo:103: 00000100:00100000:1.0:1788836108.506683:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538435712:0@lo:104: 00010000:00010000:1.0:1788836108.506707:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506763:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.506768:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506775:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836108.506778:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506785:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836108.506790:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836108.506801:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836108.506819:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506826:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836108.506838:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506844:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2600/0xcb5b7bc40b909012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909019 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.506855:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.506856:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.506858:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836108.506872:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538436096:0@lo:103: 00000100:00100000:1.0:1788836108.506897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.506949:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435840 00000100:00100000:1.0:1788836108.506953:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435840 00010000:00010000:1.0:1788836108.506972:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 13 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.506992:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436096 00000100:00100000:1.0:1788836108.506996:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436096 00010000:00010000:1.0:1788836108.507006:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 14 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.507016:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836108.507022:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3304:x1875730538435840:12345-0@lo:103: 00010000:00010000:1.0:1788836108.507031:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836108.507042:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 14 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.507053:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 14 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.507065:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9090a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90909e expref: 14 pid: 5824 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.507078:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836108.507189:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788836108.507197:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788836108.507282:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788836108.507292:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836108.507299:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3302:x1875730538436096:12345-0@lo:103: 00010000:00010000:2.0:1788836108.507308:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836108.507313:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 13 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.507321:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 13 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.507330:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909012 expref: 13 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.507339:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836108.507407:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3302:x1875730538436096:12345-0@lo:103: Request processed in 109us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.507413:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836108.507537:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538436096:0@lo:103: 00000100:00100000:1.0:1788836108.507700:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3304:x1875730538435840:12345-0@lo:103: Request processed in 677us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836108.507706:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788836108.507722:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.507725:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836108.508377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.508413:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538435840:0@lo:103: 00010000:00010000:0.0:1788836108.508485:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.508494:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90902e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909035 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836108.509133:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538435968 00000100:00100000:2.0:1788836108.509142:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538435968 00010000:00010000:2.0:1788836108.509170:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 11 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836108.509206:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836108.509214:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3304:x1875730538435968:12345-0@lo:103: 00010000:00010000:2.0:1788836108.509225:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836108.509238:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 11 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509248:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 11 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509262:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90902e expref: 11 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509276:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509284:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509299:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509306:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509313:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509319:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509325:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836108.509328:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509336:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509375:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.509385:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836108.509433:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:3304:x1875730538435968:12345-0@lo:103: Request processed in 220us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.509440:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788836108.509442:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.509450:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.509456:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909100 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836108.509471:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788836108.509557:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538435968:0@lo:103: 00010000:00010000:1.0:1788836108.511976:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.511981:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.511983:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836108.581131:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:6678:x1875730538435328:12345-0@lo:253: Request processed in 84438us (84661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.581144:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836108.581225:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538435328:0@lo:253: 10000000:01000000:3.0:1788836108.581241:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788836108.581244:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836108.581245:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836108.581247:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836108.581248:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788836108.581249:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836108.581250:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836108.581252:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836108.581254:0:6678:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788836108.581255:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836108.581256:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836108.581274:0:6678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd078fee000 from lustre-OST0000 10000000:01000000:3.0:1788836108.581434:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788836108.581437:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836108.581444:0:6678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd046738000 local copy 10000000:01000000:3.0:1788836108.581448:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836108.581481:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.581492:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.581500:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836108.581517:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436224:0@lo:101: 00000100:00100000:3.0:1788836108.581551:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.581765:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.581968:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436224 00000100:00100000:2.0:1788836108.581975:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436224 00000100:00100000:2.0:1788836108.582051:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836108.582060:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+9:6678:x1875730538436224:12345-0@lo:101: 00010000:00010000:2.0:1788836108.582072:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836108.582087:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90910e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909107 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.582109:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90910e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909107 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.582120:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90910e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909107 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.582128:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2600, rc 0) 00000100:00100000:2.0:1788836108.582172:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:6678:x1875730538436224:12345-0@lo:101: Request processed in 112us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.582178:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836108.582254:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436224:0@lo:101: 00010000:00010000:0.0:1788836108.582266:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.582281:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.582426:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436352:0@lo:501: 00000100:00100000:0.0:1788836108.582455:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.582760:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.582868:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436352 00000100:00100000:3.0:1788836108.582874:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436352 00000100:00100000:3.0:1788836108.582897:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836108.582917:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:6678:x1875730538436352:12345-0@lo:501: 00000100:00100000:3.0:1788836108.583133:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:6678:x1875730538436352:12345-0@lo:501: Request processed in 228us (676us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836108.583140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836108.583384:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436352:0@lo:501: 10000000:01000000:0.0:1788836108.583403:0:6678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788836108.583432:0:6678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788836108.583439:0:6678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.583447:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.583454:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.583470:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788836108.583488:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd078fee000 10000000:01000000:0.0:1788836108.583493:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788836108.583497:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd046738000 10000000:01000000:0.0:1788836108.583499:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788836108.583502:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd046738000 from 1 10000000:01000000:0.0:1788836108.583505:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788836108.583523:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.583541:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.583550:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.583563:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436480:0@lo:101: 00000100:00100000:0.0:1788836108.583591:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.583740:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788836108.583825:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836108.583831:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.583838:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836108.583841:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.583849:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836108.583855:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836108.583861:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836108.583879:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.583886:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836108.583921:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.583928:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b909107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b90910e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.583949:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836108.583951:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836108.583953:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836108.583961:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836108.583973:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538436608:0@lo:103: 00000100:00100000:3.0:1788836108.584002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.584027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436480 00000100:00100000:3.0:1788836108.584032:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436480 00000100:00100000:3.0:1788836108.584054:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836108.584060:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:6678:x1875730538436480:12345-0@lo:101: 00010000:00010000:3.0:1788836108.584070:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836108.584082:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0ce00/0xcb5b7bc40b90911c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909115 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.584101:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0ce00/0xcb5b7bc40b90911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909115 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.584110:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0ce00/0xcb5b7bc40b90911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909115 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.584118:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ce00, rc 0) 00000100:00100000:3.0:1788836108.584144:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436480:12345-0@lo:101: Request processed in 84us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.584150:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836108.584176:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436608 00000100:00100000:3.0:1788836108.584180:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436608 00000100:00100000:3.0:1788836108.584212:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836108.584219:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3302:x1875730538436608:12345-0@lo:103: 00010000:00010000:3.0:1788836108.584235:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836108.584247:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b90910e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909107 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.584259:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836108.584299:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:3302:x1875730538436608:12345-0@lo:103: Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.584306:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836108.584332:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538436608:0@lo:103: 00000100:00100000:0.0:1788836108.584791:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436480:0@lo:101: 00010000:00010000:0.0:1788836108.584804:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.584812:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836108.584828:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788836108.584845:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.584852:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836108.584860:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788836108.584865:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836108.584869:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788836108.584871:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788836108.584887:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.584900:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.584923:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.584936:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436736:0@lo:101: 00000100:00100000:0.0:1788836108.584965:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.584994:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.585079:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436736 00000100:00100000:3.0:1788836108.585084:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436736 00000100:00100000:3.0:1788836108.585116:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836108.585123:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+10:6678:x1875730538436736:12345-0@lo:101: 00010000:00010000:3.0:1788836108.585132:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836108.585141:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909123 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.585156:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.585164:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.585170:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c000, rc 0) 00000100:00100000:3.0:1788836108.585197:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436736:12345-0@lo:101: Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.585203:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836108.585274:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436736:0@lo:101: 00010000:00010000:0.0:1788836108.585414:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.585423:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.585504:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436864:0@lo:501: 00000100:00100000:0.0:1788836108.585527:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.585547:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.585593:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436864 00000100:00100000:3.0:1788836108.585607:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436864 00000100:00100000:3.0:1788836108.585643:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836108.585648:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436864:12345-0@lo:501: 00000100:00100000:3.0:1788836108.585984:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436864:12345-0@lo:501: Request processed in 334us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.585991:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836108.586111:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436864:0@lo:501: 00000100:00100000:0.0:1788836108.586139:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436992:0@lo:503: 00000100:00100000:0.0:1788836108.586177:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.586203:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.586380:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538436992 00000100:00100000:3.0:1788836108.586384:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538436992 00000100:00100000:3.0:1788836108.586406:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836108.586413:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436992:12345-0@lo:503: 00000100:00100000:3.0:1788836108.586563:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538436992:12345-0@lo:503: Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.586570:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836108.586654:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538436992:0@lo:503: 00000040:00080000:2.0:1788836108.588838:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836108.588949:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437120:0@lo:502: 00000100:00100000:2.0:1788836108.589016:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836108.589056:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.589417:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437120 00000100:00100000:3.0:1788836108.589425:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437120 00000100:00100000:3.0:1788836108.589464:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836108.589472:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538437120:12345-0@lo:502: 00000100:00100000:3.0:1788836108.590039:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538437120:12345-0@lo:502: Request processed in 566us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.590047:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836108.590146:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437120:0@lo:502: 00000040:00080000:2.0:1788836108.590917:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788836108.590984:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788836108.591021:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788836108.591071:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788836108.591109:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788836108.591143:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788836108.591180:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437248:0@lo:502: 00000100:00100000:2.0:1788836108.591235:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836108.591276:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836108.591453:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437248 00000100:00100000:0.0:1788836108.591462:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437248 00000100:00100000:0.0:1788836108.591513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836108.591528:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538437248:12345-0@lo:502: 00000100:00100000:0.0:1788836108.591879:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538437248:12345-0@lo:502: Request processed in 351us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.591886:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836108.592046:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437248:0@lo:502: 00000040:00080000:2.0:1788836108.592150:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788836108.592162:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788836108.596763:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836108.596775:0:6698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788836108.596783:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836108.596786:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788836108.596793:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836108.596808:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd07d378000) 00000020:00000080:0.0:1788836108.596830:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788836108.596835:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788836108.596899:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd078fee000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788836108.596919:0:6698:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788836108.596925:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b909138 00010000:00010000:3.0:1788836108.610091:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788836108.610793:0:6698:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788836108.615226:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788836108.615822:0:6698:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788836108.630508:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788836108.631246:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788836108.633012:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788836108.633023:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836108.633029:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836108.633031:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788836108.633033:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836108.633037:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836108.633038:0:6698:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836108.633041:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836108.633043:0:6698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836108.633098:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836108.633102:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836108.633103:0:6698:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788836108.633106:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788836108.633266:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788836108.633289:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788836108.633310:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.633331:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836108.633339:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd078fee000 from 1 10000000:01000000:3.0:1788836108.633370:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836108.633401:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.633408:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.633417:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836108.633435:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437376:0@lo:101: 00000100:00100000:3.0:1788836108.633501:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.633538:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836108.633757:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437376 00000100:00100000:1.0:1788836108.633764:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437376 00000100:00100000:1.0:1788836108.633805:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788836108.633813:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:6678:x1875730538437376:12345-0@lo:101: 00010000:00010000:1.0:1788836108.633824:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836108.633835:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90913f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.633854:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.633863:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.633880:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377c00, rc 0) 00000100:00100000:1.0:1788836108.633929:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437376:12345-0@lo:101: Request processed in 117us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836108.633936:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836108.634121:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437376:0@lo:101: 00010000:00010000:3.0:1788836108.634134:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.634143:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836108.634229:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437504:0@lo:501: 00000100:00100000:3.0:1788836108.634253:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.634283:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.634334:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437504 00000100:00100000:2.0:1788836108.634339:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437504 00000100:00100000:2.0:1788836108.634392:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836108.634399:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437504:12345-0@lo:501: 00000100:00100000:2.0:1788836108.634990:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437504:12345-0@lo:501: Request processed in 588us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.634998:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836108.638094:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437504:0@lo:501: 00000100:00100000:1.0:1788836108.644373:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437632:0@lo:503: 00000100:00100000:1.0:1788836108.644462:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.644857:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047f116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.647428:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437632 00000100:00100000:2.0:1788836108.647442:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437632 00000100:00100000:2.0:1788836108.647507:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836108.647517:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437632:12345-0@lo:503: 00000100:00100000:2.0:1788836108.648223:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437632:12345-0@lo:503: Request processed in 704us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.648232:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788836108.648336:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437632:0@lo:503: 00000040:00080000:1.0:1788836108.649018:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836108.649085:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437760:0@lo:502: 00000100:00100000:1.0:1788836108.649137:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.649177:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047f116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.649523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437760 00000100:00100000:2.0:1788836108.649530:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437760 00000100:00100000:2.0:1788836108.649572:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836108.649580:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437760:12345-0@lo:502: 00000100:00100000:2.0:1788836108.650170:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437760:12345-0@lo:502: Request processed in 589us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.650177:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836108.650237:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437760:0@lo:502: 00000040:00080000:2.0:1788836108.651849:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788836108.654842:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788836108.654923:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437888:0@lo:502: 00000100:00100000:2.0:1788836108.654999:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836108.655071:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836108.655219:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538437888 00000100:00100000:0.0:1788836108.655225:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538437888 00000100:00100000:0.0:1788836108.655270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788836108.655278:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437888:12345-0@lo:502: 00000100:00100000:0.0:1788836108.655509:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538437888:12345-0@lo:502: Request processed in 231us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.655517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836108.655605:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538437888:0@lo:502: 00000040:00080000:3.0:1788836108.655734:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788836108.655744:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788836108.656501:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836108.656509:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836108.656512:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836108.656520:0:6702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd078fee000 00000020:00000080:3.0:1788836108.656522:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836108.656540:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836108.656543:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836108.656544:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836108.656547:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788836108.656782:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788836108.656803:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836108.656822:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.656834:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836108.656872:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836108.656875:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd078fee000 10000000:01000000:2.0:1788836108.656880:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd078fee000 10000000:01000000:2.0:1788836108.656884:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836108.656889:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd078fee000 from 1 10000000:01000000:2.0:1788836108.656892:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836108.656933:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.656941:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.656951:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836108.656969:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438016:0@lo:101: 00000100:00100000:2.0:1788836108.657018:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836108.657046:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836108.657159:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438016 00000100:00100000:0.0:1788836108.657166:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438016 00000100:00100000:0.0:1788836108.657207:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788836108.657215:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538438016:12345-0@lo:101: 00010000:00010000:0.0:1788836108.657227:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836108.657239:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90914d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.657276:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.657287:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.657296:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:0.0:1788836108.657338:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438016:12345-0@lo:101: Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.657363:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836108.657461:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438016:0@lo:101: 00010000:00010000:3.0:1788836108.657473:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.657482:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836108.657564:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438144:0@lo:501: 00000100:00100000:3.0:1788836108.657592:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.657616:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836108.657805:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438144 00000100:00100000:0.0:1788836108.657810:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438144 00000100:00100000:0.0:1788836108.657834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836108.657840:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438144:12345-0@lo:501: 00000100:00100000:0.0:1788836108.658053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438144:12345-0@lo:501: Request processed in 213us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.658060:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788836108.658116:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438144:0@lo:501: 00000100:00100000:3.0:1788836108.658142:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438272:0@lo:503: 00000100:00100000:3.0:1788836108.658177:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.658198:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.658261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438272 00000100:00100000:2.0:1788836108.658272:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438272 00000100:00100000:2.0:1788836108.658304:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836108.658311:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438272:12345-0@lo:503: 00000100:00100000:2.0:1788836108.658475:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438272:12345-0@lo:503: Request processed in 164us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836108.658482:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836108.658772:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438272:0@lo:503: 00000040:00080000:3.0:1788836108.659031:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836108.659099:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438400:0@lo:502: 00000100:00100000:3.0:1788836108.659138:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.659207:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836108.659925:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438400 00000100:00100000:0.0:1788836108.659932:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438400 00000100:00100000:0.0:1788836108.660010:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836108.660018:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438400:12345-0@lo:502: 00000100:00100000:0.0:1788836108.660232:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438400:12345-0@lo:502: Request processed in 215us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.660240:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836108.660311:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438400:0@lo:502: 00000040:00080000:3.0:1788836108.660622:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788836108.660685:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788836108.660720:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788836108.660767:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788836108.660806:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788836108.660849:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788836108.660880:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788836108.660927:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788836108.660976:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788836108.661013:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788836108.661047:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788836108.661093:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788836108.661129:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788836108.661158:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788836108.661212:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788836108.661245:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788836108.661290:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788836108.661372:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788836108.661406:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788836108.661438:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788836108.661484:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788836108.661522:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788836108.661558:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788836108.661607:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788836108.661642:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788836108.661689:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788836108.661739:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788836108.661777:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788836108.661816:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438528:0@lo:502: 00000100:00100000:3.0:1788836108.661881:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.662572:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836108.662743:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438528 00000100:00100000:2.0:1788836108.662751:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438528 00000100:00100000:1.0:1788836108.662921:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836108.662931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438528:12345-0@lo:502: 00000100:00100000:1.0:1788836108.663161:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438528:12345-0@lo:502: Request processed in 231us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836108.663168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836108.663245:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438528:0@lo:502: 00000040:00080000:3.0:1788836108.663334:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788836108.663376:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788836108.664059:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788836108.664072:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd07b2b3370) 00000020:00000080:3.0:1788836108.664089:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788836108.664172:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd078fee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788836108.664177:0:6703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd078fee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788836108.664179:0:6703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd078fee000 3 00010000:00080000:3.0:1788836108.664207:0:6703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bcf45113000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836108.668956:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788836108.669150:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788836108.669187:0:6703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836108.669199:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcb5b7bc40b909162 00000100:00080000:3.0:1788836108.669209:0:6703:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836108.669215:0:6703:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bcf45113000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836108.669247:0:6703:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd04674c000 x1875730538438656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836108.669275:0:6703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788836108.669852:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538438784:0@lo:400: 00000100:00100000:3.0:1788836108.669938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836108.669997:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438784 00000100:00100000:3.0:1788836108.670010:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438784 00000100:00100000:3.0:1788836108.670051:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836108.670060:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538438784:12345-0@lo:400: 00000100:00100000:3.0:1788836108.670113:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538438784:12345-0@lo:400: Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.670119:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836108.670155:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd078fb4e00 x1875730538438784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836108.670168:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538438784:0@lo:400: 00000100:00100000:0.0:1788836108.672195:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538438656:0@lo:38: 00000100:00100000:0.0:1788836108.672261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.672329:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438656 00000100:00100000:0.0:1788836108.672335:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438656 00000100:00100000:0.0:1788836108.672394:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836108.672402:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1875730538438656:12345-0@lo:38: 00010000:00080000:0.0:1788836108.672426:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:0.0:1788836108.672470:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcb5b7bc40b909169 00000004:00100000:0.0:1788836108.672483:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836108.672514:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9bd07a91d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836108.672562:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875730538438656:12345-0@lo:38: Request processed in 159us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.672569:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788836108.672605:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd04674c000 x1875730538438656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836108.672615:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836108.672622:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788836108.672629:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836108.672633:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836108.672635:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf45113000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836108.672640:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538438656:0@lo:38: 00000040:00080000:3.0:1788836108.673877:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788836108.674055:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788836108.674081:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836108.674101:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836108.674112:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836108.674161:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836108.674164:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836108.674165:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836108.674166:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836108.674167:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836108.674168:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836108.674170:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836108.674171:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836108.674172:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836108.674174:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836108.674175:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836108.674178:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788836108.674181:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836108.674182:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836108.674183:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836108.674184:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836108.674185:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836108.674186:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836108.674192:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836108.674194:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836108.674194:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836108.674195:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836108.674196:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836108.674219:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788836108.674234:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438912:0@lo:253: 00000100:00100000:2.0:1788836108.674288:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836108.674320:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.674427:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538438912 00000100:00100000:3.0:1788836108.674434:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538438912 00000100:00100000:3.0:1788836108.674556:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836108.674566:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6678:x1875730538438912:12345-0@lo:253: 20000000:01000000:3.0:1788836108.674601:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788836108.674738:0:5822:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788836108.719849:0:5822:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788836108.719871:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788836108.720035:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788836108.720041:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788836108.720062:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.720080:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.720089:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.720151:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.720166:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 13 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.720180:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454baa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538439040:0@lo:104: 00000100:00100000:0.0:1788836108.720410:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836108.720775:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047fbbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836108.720835:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439040 00000100:00100000:3.0:1788836108.720843:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439040 00000100:00100000:3.0:1788836108.720979:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836108.720991:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538439040:12345-0@lo:104: 00010000:00010000:3.0:1788836108.721005:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836108.721069:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836108.721076:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538439040:12345-0@lo:104: Request processed in 88us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836108.721084:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836108.721300:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454baa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538439040:0@lo:104: 00010000:00010000:0.0:1788836108.721320:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721419:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836108.721496:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721505:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836108.721509:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721544:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836108.721551:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836108.721558:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788836108.721598:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721605:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836108.721636:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721644:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2400/0xcb5b7bc40b9090cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090d6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.721946:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.721948:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836108.721950:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836108.721964:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538439168:0@lo:103: 00000100:00100000:1.0:1788836108.722009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836108.722059:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439168 00000100:00100000:1.0:1788836108.722065:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439168 00010000:00010000:1.0:1788836108.722085:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 14 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836108.722201:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836108.722210:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3305:x1875730538439168:12345-0@lo:103: 00010000:00010000:1.0:1788836108.722229:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836108.722235:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 14 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722247:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 14 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722260:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b9090d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9090cf expref: 14 pid: 5823 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722273:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722281:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836108.722294:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002254366s 00010000:00010000:1.0:1788836108.722299:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722307:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722313:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722320:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722326:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836108.722329:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722376:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722389:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836108.722401:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836108.722434:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047944c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3305:x1875730538439168:12345-0@lo:103: Request processed in 225us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836108.722441:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836108.722509:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538439168:0@lo:103: 00010000:00010000:0.0:1788836108.723426:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.723439:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836108.723504:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b909170 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836108.728034:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:6678:x1875730538438912:12345-0@lo:253: Request processed in 53461us (53735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836108.728048:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788836108.728069:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6678:1875730538438912:0@lo:253: 10000000:01000000:2.0:1788836108.728087:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836108.728090:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836108.728093:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836108.728094:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836108.728095:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836108.728096:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836108.728098:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836108.728099:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836108.728100:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788836108.728101:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788836108.728103:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836108.728104:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836108.728120:0:6678:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788836108.734950:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788836108.735134:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788836108.735380:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788836108.735810:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788836108.737019:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788836108.737285:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788836108.739169:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788836108.913367:0:6678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788836108.913374:0:6678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788836108.913407:0:6678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836108.913460:0:6678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836108.913473:0:6678:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788836108.913497:0:6678:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788836109.073442:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836110.096549:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788836110.801983:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788836110.801993:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd0497a5800 from 21 10000000:01000000:1.0:1788836110.802000:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836110.802055:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.802068:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.802083:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836110.802122:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439296:0@lo:101: 00000100:00100000:1.0:1788836110.802209:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836110.802282:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836110.802397:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439296 00000100:00100000:2.0:1788836110.802407:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439296 00000100:00100000:2.0:1788836110.802472:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836110.802483:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538439296:12345-0@lo:101: 00010000:00010000:2.0:1788836110.802499:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836110.802515:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909177 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836110.802558:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836110.802569:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836110.802580:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2c00, rc 0) 00000100:00100000:2.0:1788836110.802627:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439296:12345-0@lo:101: Request processed in 146us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.802634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836110.803909:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439296:0@lo:101: 00010000:00010000:1.0:1788836110.803937:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.803949:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836110.804040:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439424:0@lo:501: 00000100:00100000:1.0:1788836110.804093:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836110.804147:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836110.804499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439424 00000100:00100000:2.0:1788836110.804507:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439424 00000100:00100000:2.0:1788836110.804558:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836110.804569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439424:12345-0@lo:501: 00000100:00100000:2.0:1788836110.805192:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439424:12345-0@lo:501: Request processed in 623us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.805202:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836110.805238:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439424:0@lo:501: 00000100:00100000:1.0:1788836110.805286:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439552:0@lo:503: 00000100:00100000:1.0:1788836110.805334:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836110.805399:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836110.805510:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439552 00000100:00100000:2.0:1788836110.805515:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439552 00000100:00100000:2.0:1788836110.805541:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836110.805548:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439552:12345-0@lo:503: 00000100:00100000:2.0:1788836110.807451:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439552:12345-0@lo:503: Request processed in 1891us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.807466:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788836110.807959:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439552:0@lo:503: 00000100:00100000:3.0:1788836110.808560:0:6828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6828:1875730538439680:0@lo:502: 00000100:00100000:3.0:1788836110.808627:0:6828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.808673:0:6828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf452276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836110.808735:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439680 00000100:00100000:2.0:1788836110.808744:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439680 00000100:00100000:2.0:1788836110.808795:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836110.808812:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6828:x1875730538439680:12345-0@lo:502: 00000100:00100000:2.0:1788836110.809155:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6828:x1875730538439680:12345-0@lo:502: Request processed in 343us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.809164:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836110.809440:0:6828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6828:1875730538439680:0@lo:502: 00000100:00100000:3.0:1788836110.809496:0:6828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6828:1875730538439808:0@lo:502: 00000100:00100000:3.0:1788836110.809534:0:6828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.809568:0:6828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf452276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836110.809629:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439808 00000100:00100000:2.0:1788836110.809634:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439808 00000100:00100000:2.0:1788836110.809714:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836110.809721:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6828:x1875730538439808:12345-0@lo:502: 00000100:00100000:2.0:1788836110.809898:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:6828:x1875730538439808:12345-0@lo:502: Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.809906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788836110.809983:0:6828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6828:1875730538439808:0@lo:502: 00000040:00080000:1.0:1788836110.810006:0:6828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788836110.810073:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788836110.810095:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836110.810106:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.810133:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836110.810144:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836110.810148:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd0497a5800 from 4 10000000:01000000:1.0:1788836110.810151:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836110.810187:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.810196:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836110.810206:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836110.810222:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439936:0@lo:101: 00000100:00100000:1.0:1788836110.810257:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836110.810556:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.810646:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538439936 00000100:00100000:3.0:1788836110.810652:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538439936 00000100:00100000:3.0:1788836110.810685:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836110.810691:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538439936:12345-0@lo:101: 00010000:00010000:3.0:1788836110.810702:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836110.810717:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909185 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.810744:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.810755:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.810765:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c200, rc 0) 00000100:00100000:3.0:1788836110.810807:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538439936:12345-0@lo:101: Request processed in 116us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.810813:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788836110.810849:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538439936:0@lo:101: 00010000:00010000:3.0:1788836110.810864:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.810873:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836110.810937:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440064:0@lo:256: 00000100:00100000:3.0:1788836110.810970:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.810983:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45227840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.810995:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440064 00000100:00100000:3.0:1788836110.810998:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440064 00000100:00100000:3.0:1788836110.811014:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836110.811020:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538440064:12345-0@lo:256: 20000000:01000000:3.0:1788836110.811034:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788836110.811055:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788836110.811059:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788836110.811139:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538440064:12345-0@lo:256: Request processed in 118us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.811146:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836110.811173:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440064:0@lo:256: 10000000:01000000:3.0:1788836110.811213:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836110.811219:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811236:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836110.811245:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788836110.811247:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788836110.811250:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836110.811268:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811276:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811284:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836110.811296:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440192:0@lo:101: 00000100:00100000:3.0:1788836110.811321:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.811334:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45227840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.811371:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440192 00000100:00100000:3.0:1788836110.811374:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440192 00000100:00100000:3.0:1788836110.811393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836110.811401:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538440192:12345-0@lo:101: 00010000:00010000:3.0:1788836110.811409:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836110.811419:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909193 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811436:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811458:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811465:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d200, rc 0) 00000100:00100000:3.0:1788836110.811495:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538440192:12345-0@lo:101: Request processed in 95us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.811500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836110.811529:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440192:0@lo:101: 00010000:00010000:3.0:1788836110.811538:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.811546:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836110.811592:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440320:0@lo:501: 00000100:00100000:3.0:1788836110.811618:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.811639:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45227840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.811650:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440320 00000100:00100000:3.0:1788836110.811654:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440320 00000100:00100000:3.0:1788836110.811670:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836110.811676:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538440320:12345-0@lo:501: 00000100:00100000:3.0:1788836110.812710:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538440320:12345-0@lo:501: Request processed in 1028us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.812721:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836110.812800:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440320:0@lo:501: 00000100:00100000:2.0:1788836110.812851:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440448:0@lo:503: 00000100:00100000:2.0:1788836110.812914:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836110.812984:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048579f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836110.813023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440448 00000100:00100000:1.0:1788836110.813031:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440448 00000100:00100000:1.0:1788836110.813112:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788836110.813121:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538440448:12345-0@lo:503: 00000100:00100000:1.0:1788836110.813667:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538440448:12345-0@lo:503: Request processed in 545us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836110.813674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836110.813994:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538440448:0@lo:503: 00000100:00100000:3.0:1788836110.814552:0:6829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6829:1875730538440576:0@lo:502: 00000100:00100000:3.0:1788836110.814621:0:6829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836110.814925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440576 00000100:00100000:2.0:1788836110.814934:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440576 00000100:00100000:3.0:1788836110.814943:0:6829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf45227840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836110.815138:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788836110.815151:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:6829:x1875730538440576:12345-0@lo:502: 00000100:00100000:1.0:1788836110.815499:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:6829:x1875730538440576:12345-0@lo:502: Request processed in 350us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836110.815507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836110.815608:0:6829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6829:1875730538440576:0@lo:502: 00000020:01000000:2.0:1788836110.815642:0:6829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836110.815652:0:6829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788836110.815659:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836110.815662:0:6829:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788836110.815667:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836110.815671:0:6829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1788836110.815697:0:6829:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836110.815700:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836110.815718:0:6829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd044d03370) 00000020:00000080:2.0:1788836110.815750:0:6829:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788836110.815758:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836110.815854:0:6829:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788836110.815861:0:6829:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788836110.815869:0:6829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b9091a8 00010000:00080000:2.0:1788836110.815916:0:6829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd047ea3800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836110.816239:0:6829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788836110.863790:0:6829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788836110.863820:0:6829:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788836110.864587:0:6829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836110.865086:0:6829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836110.865233:0:6829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788836110.865305:0:6829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788836110.866386:0:6831:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836110.866393:0:6831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788836110.867834:0:6829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836110.867849:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836110.867901:0:6829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788836110.867929:0:6829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b9091af 00000100:00080000:2.0:1788836110.867943:0:6829:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836110.867950:0:6829:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd047ea3800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836110.867999:0:6829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07b255180 x1875730538440704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836110.868069:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538440704:0@lo:8: 00000100:00100000:1.0:1788836110.868235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.868366:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440704 00000100:00100000:3.0:1788836110.868374:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440704 00000100:00100000:3.0:1788836110.868412:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836110.868422:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538440704:12345-0@lo:8: 00010000:00080000:3.0:1788836110.868450:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788836110.868483:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b9091b6 00002000:00100000:3.0:1788836110.868522:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bcf45110800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788836110.868527:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788836110.868532:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788836110.868694:0:6829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00002000:00100000:3.0:1788836110.868695:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788836110.868776:0:6829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836110.868782:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836110.868784:0:6829:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788836110.868787:0:6829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836110.868791:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836110.868792:0:6829:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836110.868796:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836110.868798:0:6829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788836110.868828:0:6829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6829:1875730538440832:0@lo:502: 00002000:00080000:3.0:1788836110.868847:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836110.868881:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bd05274f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836110.868903:0:6829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836110.868924:0:6829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836110.869026:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538441088:0@lo:400: 00000100:00100000:0.0:1788836110.869063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836110.869144:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836110.869163:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538440960:0@lo:400: 00000100:00100000:0.0:1788836110.869189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836110.869219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441088 00000100:00100000:0.0:1788836110.869225:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441088 00000100:00100000:3.0:1788836110.869230:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538440704:12345-0@lo:8: Request processed in 808us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.869238:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836110.869266:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440960 00000100:00100000:0.0:1788836110.869270:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440960 00000100:00100000:0.0:1788836110.869285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836110.869292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538441088:12345-0@lo:400: 00010000:00080000:1.0:1788836110.869307:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b255180 x1875730538440704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836110.869319:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836110.869328:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788836110.869337:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1788836110.869360:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538441088:12345-0@lo:400: Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836110.869368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836110.869384:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836110.869390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538440960:12345-0@lo:400: 00010000:00080000:3.0:1788836110.869392:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd0454b8700 x1875730538441088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836110.869414:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538441088:0@lo:400: 00000100:00100000:0.0:1788836110.869416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538440960:12345-0@lo:400: Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836110.869421:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788836110.869436:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd0454baa00 x1875730538440960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836110.869440:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836110.869444:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538440960:0@lo:400: 00000100:00080000:1.0:1788836110.869535:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788836110.869539:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd047ea3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788836110.869551:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788836110.869556:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538440704:0@lo:8: 00000004:00080000:3.0:1788836110.870058:0:6831:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788836110.870417:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538440832 00000004:00080000:3.0:1788836110.870427:0:6831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164005083230ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788836110.870428:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538440832 00000100:00100000:2.0:1788836110.870473:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836110.870482:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:6829:x1875730538440832:12345-0@lo:502: 00000100:00100000:2.0:1788836110.871250:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:6829:x1875730538440832:12345-0@lo:502: Request processed in 764us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836110.871260:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836110.871907:0:6829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:6829:1875730538440832:0@lo:502: 00000020:01000000:2.0:1788836110.871951:0:6829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836110.871960:0:6829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836110.871962:0:6829:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788836110.871967:0:6829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788836110.874337:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788836110.874538:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836110.874554:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.874568:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836110.874580:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788836110.874583:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd046738000 from 1 10000000:01000000:3.0:1788836110.874587:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836110.874697:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.874706:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.874719:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836110.874747:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538441216:0@lo:101: 00000100:00100000:3.0:1788836110.874997:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.875062:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf452276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.875100:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441216 00000100:00100000:3.0:1788836110.875109:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441216 00000100:00100000:3.0:1788836110.875170:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836110.875258:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538441216:12345-0@lo:101: 00010000:00010000:3.0:1788836110.875373:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836110.875391:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9091bd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.875423:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.875437:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.875447:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c600, rc 0) 00000100:00100000:3.0:1788836110.875501:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538441216:12345-0@lo:101: Request processed in 320us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836110.875511:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836110.875579:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538441216:0@lo:101: 00010000:00010000:3.0:1788836110.875602:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.875626:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836110.875693:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538441344:0@lo:501: 00000100:00100000:3.0:1788836110.875741:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.875969:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf452276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.875986:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441344 00000100:00100000:3.0:1788836110.875990:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441344 00000100:00100000:3.0:1788836110.876020:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836110.876027:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538441344:12345-0@lo:501: 00000100:00100000:3.0:1788836110.876499:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538441344:12345-0@lo:501: Request processed in 460us (748us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836110.876517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836110.876984:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538441344:0@lo:501: 10000000:01000000:3.0:1788836110.877021:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788836110.877031:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836110.877042:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836110.924996:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788836110.966930:0:6832:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788836110.966974:0:6832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441600:0@lo:7: 00000100:00100000:1.0:1788836110.967062:0:6832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836110.967123:0:6832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048a2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836110.967130:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836110.967176:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441600 00000100:00100000:1.0:1788836110.967186:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441600 00000100:00100000:0.0:1788836110.967215:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538441472:0@lo:13: 00000100:00100000:1.0:1788836110.967253:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836110.967266:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6832:x1875730538441600:12345-0@lo:7: 00000100:00100000:0.0:1788836110.967290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836110.967337:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836110.968205:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441472 00000100:00100000:0.0:1788836110.968216:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441472 00000100:00100000:0.0:1788836110.968330:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836110.968359:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875730538441472:12345-0@lo:13: 00002000:00000024:0.0:1788836110.968403:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788836110.968603:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875730538441472:12345-0@lo:13: Request processed in 262us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836110.968631:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788836110.968734:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd078fb4000 x1875730538441472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836110.968762:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538441472:0@lo:13: 00002000:00080000:1.0:1788836110.973524:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788836110.973535:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788836110.973735:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6832:x1875730538441600:12345-0@lo:7: Request processed in 6463us (6663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836110.973755:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788836110.973782:0:6832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd078fb7b80 x1875730538441600/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836110.973803:0:6832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441600:0@lo:7: 00000004:00080000:2.0:1788836110.973821:0:6832:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788836110.973875:0:6832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441728:0@lo:5: 00000100:00100000:2.0:1788836110.973939:0:6832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.974040:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441728 00000100:00100000:3.0:1788836110.974049:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441728 00000100:00100000:3.0:1788836110.974109:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836110.974120:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6832:x1875730538441728:12345-0@lo:5: 00002000:00080000:3.0:1788836110.974152:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788836110.974156:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788836110.974459:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6832:x1875730538441728:12345-0@lo:5: Request processed in 341us (519us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788836110.974467:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836110.974632:0:6832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707300 going to sleep for 11 seconds 00010000:00080000:2.0:1788836110.974663:0:6832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b256300 x1875730538441728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836110.974676:0:6832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441728:0@lo:5: 00000004:00080000:2.0:1788836110.974687:0:6832:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788836110.974717:0:6832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441856:0@lo:700: 00000100:00100000:2.0:1788836110.974744:0:6832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836110.974867:0:6832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836110.974990:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441856 00000100:00100000:3.0:1788836110.974996:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441856 00000100:00100000:3.0:1788836110.975069:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836110.975077:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6832:x1875730538441856:12345-0@lo:700: 00000100:00100000:3.0:1788836110.975110:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875730538441984:0@lo:700: 00000100:00100000:3.0:1788836110.975142:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836110.975169:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048912b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836110.975289:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538441984 00000100:00100000:0.0:1788836110.975303:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538441984 00000100:00100000:0.0:1788836110.975394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836110.975405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875730538441984:12345-0@lo:700: 40000000:02000000:2.0:1788836111.005597:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788836111.011259:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875730538441984:12345-0@lo:700: Request processed in 35850us (36108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836111.011292:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788836111.011708:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674c700 x1875730538441984/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788836126 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836111.011725:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875730538441984:0@lo:700: 40000000:02000000:3.0:1788836111.011738:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788836111.073729:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6832:x1875730538441856:12345-0@lo:700: Request processed in 98638us (98969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836111.073746:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788836111.073782:0:6832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b256680 x1875730538441856/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836126 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00080000:3.0:1788836111.073819:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788836111.073828:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788836111.073904:0:6832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538441856:0@lo:700: 00000004:02000040:1.0:1788836111.115241:0:6832:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00010000:00010000:1.0:1788836111.131483:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836111.135318:0:6832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538442112:0@lo:5: 00000100:00100000:0.0:1788836111.135420:0:6832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836111.135473:0:6832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047fbb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836111.136732:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442112 00000100:00100000:1.0:1788836111.136742:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442112 00000100:00100000:1.0:1788836111.136802:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836111.136812:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6832:x1875730538442112:12345-0@lo:5: 00002000:00080000:1.0:1788836111.147242:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788836111.147264:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788836111.151314:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6832:x1875730538442112:12345-0@lo:5: Request processed in 14495us (15885us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788836111.151327:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788836111.154127:0:6832:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd0454bad80 x1875730538442112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836111.154144:0:6832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788836111.154160:0:6832:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd0454bad80 x1875730538442112/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836127 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836111.154171:0:6832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6832:1875730538442112:0@lo:5: 00000004:00080000:1.0:1788836111.154184:0:6832:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788836112.144447:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836113.169338:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836113.884167:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788836114.194038:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836115.216898:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836116.241537:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836116.305010:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538442368:0@lo:13: 00000100:00100000:2.0:1788836116.305081:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836116.307175:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538442240:0@lo:400: 00000100:00100000:3.0:1788836116.307242:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538442496:0@lo:400: 00000100:00100000:0.0:1788836116.307242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836116.307285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836116.307300:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538442752:0@lo:400: 00000100:00100000:3.0:1788836116.307315:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538442624:0@lo:400: 00000100:00100000:0.0:1788836116.307325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836116.307339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836116.307384:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442368 00000100:00100000:3.0:1788836116.307387:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442496 00000100:00100000:3.0:1788836116.307395:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442496 00000100:00100000:0.0:1788836116.307395:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442368 00000100:00100000:3.0:1788836116.307430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442624 00000100:00100000:3.0:1788836116.307433:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442624 00000100:00100000:0.0:1788836116.307434:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836116.307442:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538442368:12345-0@lo:13: 00000100:00100000:3.0:1788836116.307449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836116.307455:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538442496:12345-0@lo:400: 00002000:00000024:0.0:1788836116.307473:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836116.307502:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538442496:12345-0@lo:400: Request processed in 46us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836116.307504:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538442368:12345-0@lo:13: Request processed in 63us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836116.307512:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836116.307516:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836116.307528:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836116.307534:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538442624:12345-0@lo:400: 00000100:00100000:0.0:1788836116.307534:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442240 00000100:00100000:0.0:1788836116.307538:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442240 00000100:00100000:0.0:1788836116.307562:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836116.307568:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538442624:12345-0@lo:400: Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836116.307569:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3305:x1875730538442240:12345-0@lo:400: 00000100:00100000:3.0:1788836116.307574:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788836116.307608:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674ce00 x1875730538442496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836116.307627:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538442496:0@lo:400: 00010000:00080000:3.0:1788836116.308073:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674ea00 x1875730538442624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836116.308077:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3305:x1875730538442240:12345-0@lo:400: Request processed in 509us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836116.308084:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538442624:0@lo:400: 00000100:00100000:0.0:1788836116.308084:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788836116.308129:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b257480 x1875730538442368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836116.308146:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538442368:0@lo:13: 00000100:00100000:0.0:1788836116.308234:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442752 00000100:00100000:0.0:1788836116.308239:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442752 00000100:00100000:0.0:1788836116.308422:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836116.308431:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875730538442752:12345-0@lo:400: 00000100:00100000:0.0:1788836116.308475:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875730538442752:12345-0@lo:400: Request processed in 47us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836116.308482:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788836116.308498:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836116.308502:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836116.308535:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674f100 x1875730538442752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836116.308545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538442752:0@lo:400: 00000100:00100000:0.0:1788836116.308556:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538442240:0@lo:400: 00000001:00080000:0.0:1788836116.356042:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788836117.264456:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836118.288450:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836119.316270:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836120.336670:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836121.368459:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836121.424756:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538443008:0@lo:400: 00000100:00100000:1.0:1788836121.424857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836121.424925:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788836121.424932:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538442880:0@lo:400: 00000100:00100000:1.0:1788836121.424974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836121.425115:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538443392:0@lo:13: 00000100:00100000:1.0:1788836121.425146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836121.425185:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538443136:0@lo:400: 00000100:00100000:1.0:1788836121.425216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836121.425236:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836121.425242:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538443264:0@lo:400: 00000100:00100000:1.0:1788836121.425264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836121.425631:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443008 00000100:00100000:1.0:1788836121.425641:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443008 00000100:00100000:1.0:1788836121.425694:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443136 00000100:00100000:1.0:1788836121.425697:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443136 00000100:00100000:1.0:1788836121.425793:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836121.425802:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538443008:12345-0@lo:400: 00000100:00100000:1.0:1788836121.425885:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538443008:12345-0@lo:400: Request processed in 84us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836121.425894:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836121.425912:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836121.425919:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538443136:12345-0@lo:400: 00000100:00100000:1.0:1788836121.425949:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538443136:12345-0@lo:400: Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836121.425955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836121.425979:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443264 00000100:00100000:1.0:1788836121.425982:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443264 00000100:00100000:1.0:1788836121.426012:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836121.426145:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443392 00000100:00100000:3.0:1788836121.426150:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443392 00000100:00100000:3.0:1788836121.426183:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836121.426190:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538443392:12345-0@lo:13: 00002000:00000024:3.0:1788836121.426223:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836121.426263:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538443392:12345-0@lo:13: Request processed in 75us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836121.426269:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788836121.426424:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836121.426430:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788836121.426465:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b254a80 x1875730538443392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836121.426478:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788836121.426506:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538443392:0@lo:13: 00010000:00080000:0.0:1788836121.426521:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd078fb6d80 x1875730538443008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836121.426532:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538443008:0@lo:400: 00010000:00080000:0.0:1788836121.426570:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd078fb7b80 x1875730538443136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836121.426579:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538443136:0@lo:400: 00000100:00100000:1.0:1788836121.426585:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538443264:12345-0@lo:400: 00000100:00100000:1.0:1788836121.426628:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538443264:12345-0@lo:400: Request processed in 610us (1362us total) trans 0 rc 0/0 00010000:00080000:0.0:1788836121.426638:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd078fb4000 x1875730538443264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836121.426643:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836121.426646:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538443264:0@lo:400: 00000100:00100000:2.0:1788836121.426890:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538442880 00000100:00100000:2.0:1788836121.426896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538442880 00000100:00100000:2.0:1788836121.426943:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836121.426951:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3303:x1875730538442880:12345-0@lo:400: 00000100:00100000:2.0:1788836121.427008:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3303:x1875730538442880:12345-0@lo:400: Request processed in 58us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836121.427015:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788836121.430569:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538442880:0@lo:400: 00010000:00010000:3.0:1788836122.385319:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788836123.292156:0:7613:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788836123.292160:0:7613:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788836123.292279:0:7613:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd079eb5000 00000020:01000004:1.0:1788836123.292293:0:7613:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788836123.292306:0:7613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788836123.292318:0:7613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd07b233370) 00000020:00000080:1.0:1788836123.292332:0:7613:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788836123.316535:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788836123.316794:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788836123.334853:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788836123.339509:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788836123.339540:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788836123.339726:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788836123.339754:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788836123.340084:0:7613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788836123.340096:0:7613:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836123.340106:0:7613:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b9091d2 00000020:01000004:3.0:1788836123.340114:0:7613:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788836123.340134:0:7613:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836123.340138:0:7613:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836123.340143:0:7613:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788836123.340164:0:7613:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788836123.340168:0:7613:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836123.357017:0:7613:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836123.357053:0:7613:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788836123.357056:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836123.357058:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836123.357059:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836123.357060:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836123.357061:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836123.357063:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836123.357064:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836123.357065:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836123.357067:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836123.357069:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836123.357070:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836123.357074:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788836123.357076:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836123.357077:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836123.357078:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836123.357079:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836123.357080:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836123.357081:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836123.357086:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836123.357087:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836123.357088:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836123.357089:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836123.357089:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836123.357114:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836123.357129:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538443520:0@lo:253: 00000100:00100000:3.0:1788836123.357199:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.357317:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.358443:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443520 00000100:00100000:0.0:1788836123.358455:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443520 00000100:00100000:0.0:1788836123.358554:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836123.358575:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:7613:x1875730538443520:12345-0@lo:253: 20000000:01000000:0.0:1788836123.358618:0:5823:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788836123.358622:0:5823:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788836123.358627:0:5823:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788836123.358630:0:5823:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788836123.359637:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836123.359866:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788836123.359881:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788836123.359919:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788836123.359927:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788836123.359958:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788836123.360008:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788836123.360398:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788836123.360418:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788836123.360420:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788836123.360454:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788836123.360463:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788836123.360507:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788836123.360515:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788836123.360546:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788836123.360554:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788836123.360582:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788836123.360639:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788836123.361326:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788836123.361366:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788836123.361368:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788836123.361402:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788836123.361410:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788836123.361439:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788836123.361446:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788836123.361474:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788836123.361482:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788836123.361537:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788836123.361572:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788836123.361587:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788836123.361590:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788836123.361595:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788836123.361597:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788836123.361599:0:5823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788836123.361610:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788836123.361612:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788836123.361644:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788836123.361646:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836123.362498:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836123.362559:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836123.362691:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788836123.363036:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788836123.363079:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788836123.363111:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788836123.363123:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788836123.363126:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836123.363850:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836123.363916:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836123.363951:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788836123.364199:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788836123.364257:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788836123.364309:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788836123.364322:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788836123.364324:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788836123.365008:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788836123.365056:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788836123.365106:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788836123.365441:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788836123.365488:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788836123.365544:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788836123.365558:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788836123.365560:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788836123.366748:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788836123.367054:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788836123.367100:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788836123.367171:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1788836123.367189:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788836123.367209:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367228:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367236:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367243:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367250:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367256:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367263:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367306:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367322:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.367337:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443648:0@lo:104: 00000100:00100000:1.0:1788836123.367437:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836123.367486:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367495:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 16 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.367504:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443776:0@lo:104: 00010000:00010000:1.0:1788836123.367541:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.367549:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 16 pid: 5823 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.367558:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443904:0@lo:104: 00000100:00100000:3.0:1788836123.367800:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788836123.367828:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.367949:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443648 00000100:00100000:3.0:1788836123.367956:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443648 00000100:00100000:1.0:1788836123.368007:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836123.368114:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.368123:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 16 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.368145:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538444032:0@lo:104: 00000100:00100000:1.0:1788836123.368167:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.368193:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443776 00000100:00100000:2.0:1788836123.368197:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443776 00000100:00100000:2.0:1788836123.368217:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538443904 00000100:00100000:2.0:1788836123.368220:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538443904 00000100:00100000:2.0:1788836123.368233:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836123.368241:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0517c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:5823:x1875730538443648:12345-0@lo:104: 00010000:00010000:2.0:1788836123.368253:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.368359:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836123.368366:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0517c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:5823:x1875730538443648:12345-0@lo:104: Request processed in 126us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.368373:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836123.368412:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836123.368418:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538443776:12345-0@lo:104: 00010000:00010000:2.0:1788836123.368432:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368581:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836123.368588:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368597:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836123.368600:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368619:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836123.368626:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836123.368631:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836123.368664:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368670:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836123.368689:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368695:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b9091bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368706:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836123.368709:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368715:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836123.368718:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368725:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836123.368731:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836123.368743:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836123.368757:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368762:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836123.368776:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368781:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d000/0xcb5b7bc40b909193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90919a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.368792:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.368793:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.368795:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836123.368818:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538444160:0@lo:103: 00000100:00100000:0.0:1788836123.368848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.368890:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538444288:0@lo:103: 00000100:00100000:0.0:1788836123.368912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.368947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444160 00000100:00100000:0.0:1788836123.368952:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444160 00010000:00010000:0.0:1788836123.368970:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 17 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836123.368990:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444288 00000100:00100000:0.0:1788836123.368993:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444288 00010000:00010000:0.0:1788836123.369016:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 18 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836123.369036:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836123.369048:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3303:x1875730538444160:12345-0@lo:103: 00010000:00010000:0.0:1788836123.369059:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836123.369064:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 18 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.369075:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 18 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.369090:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836123.369116:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3303:x1875730538444160:12345-0@lo:103: Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.369123:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836123.369138:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836123.369144:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3304:x1875730538444288:12345-0@lo:103: 00010000:00010000:0.0:1788836123.369150:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836123.369155:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 17 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.369164:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 17 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.369173:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836123.369195:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3304:x1875730538444288:12345-0@lo:103: Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.369201:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836123.369240:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538444288:0@lo:103: 00000100:00100000:0.0:1788836123.369264:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538444160:0@lo:103: 00010000:00010000:2.0:1788836123.369520:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788836123.369528:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538443776:12345-0@lo:104: Request processed in 1110us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.369536:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836123.369552:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788836123.369622:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836123.369651:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538443904:12345-0@lo:104: 00010000:00010000:2.0:1788836123.369661:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.369731:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836123.369736:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538443904:12345-0@lo:104: Request processed in 179us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.369742:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788836123.369796:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836123.369802:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.369818:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836123.369821:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.369829:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836123.369843:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836123.369848:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836123.369926:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.369934:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836123.369955:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.369962:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060377400/0xcb5b7bc40b909177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90917e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.369973:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836123.369975:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836123.369977:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836123.369989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836123.369999:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538444416:0@lo:103: 00000100:00100000:2.0:1788836123.370026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.370059:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444416 00000100:00100000:2.0:1788836123.370063:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444416 00010000:00010000:2.0:1788836123.370080:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 17 pid: 5823 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.370099:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836123.370105:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3304:x1875730538444416:12345-0@lo:103: 00010000:00010000:2.0:1788836123.370113:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836123.370118:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 17 pid: 5823 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.370127:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 17 pid: 5823 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.370140:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836123.370165:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3304:x1875730538444416:12345-0@lo:103: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.370171:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836123.370197:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538444416:0@lo:103: 00010000:00010000:1.0:1788836123.370387:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.370399:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 16 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.370409:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538444544:0@lo:104: 00000100:00100000:1.0:1788836123.370432:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836123.370719:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1300 going to sleep for 11 seconds 00010000:00010000:1.0:1788836123.370735:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c600/0xcb5b7bc40b9091c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9091bd expref: 16 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.370745:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443648:0@lo:104: 00010000:00010000:1.0:1788836123.370755:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90919a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909193 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.370763:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443776:0@lo:104: 00010000:00010000:1.0:1788836123.370770:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2c00/0xcb5b7bc40b90917e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909177 expref: 14 pid: 5823 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.370777:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538443904:0@lo:104: 00000100:00100000:3.0:1788836123.370845:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444032 00000100:00100000:3.0:1788836123.370850:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444032 00000100:00100000:2.0:1788836123.370963:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444544 00000100:00100000:2.0:1788836123.370967:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444544 00000100:00100000:2.0:1788836123.370991:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836123.370997:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538444544:12345-0@lo:104: 00010000:00010000:2.0:1788836123.371007:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371070:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836123.371076:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:5823:x1875730538444544:12345-0@lo:104: Request processed in 79us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.371083:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836123.371115:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836123.371121:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538444032:12345-0@lo:104: 00010000:00010000:2.0:1788836123.371129:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371160:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836123.371165:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5823:x1875730538444032:12345-0@lo:104: Request processed in 45us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.371171:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788836123.371184:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836123.371190:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371197:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836123.371201:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371209:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836123.371216:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836123.371221:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836123.371249:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371255:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836123.371269:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371276:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b909123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90912a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371287:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836123.371290:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371296:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836123.371300:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371307:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836123.371314:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836123.371320:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836123.371331:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371337:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836123.371366:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371384:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90914d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909154 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371398:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836123.371400:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836123.371402:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836123.371413:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538444672:0@lo:103: 00000100:00100000:2.0:1788836123.371440:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.371459:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836123.371465:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538444800:0@lo:103: 00000100:00100000:2.0:1788836123.371482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.371504:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444672 00000100:00100000:2.0:1788836123.371508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444672 00010000:00010000:2.0:1788836123.371522:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 14 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.371538:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444800 00000100:00100000:2.0:1788836123.371541:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444800 00010000:00010000:2.0:1788836123.371550:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.371577:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836123.371584:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3302:x1875730538444672:12345-0@lo:103: 00010000:00010000:2.0:1788836123.371593:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836123.371598:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371607:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371626:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836123.371650:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3302:x1875730538444672:12345-0@lo:103: Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.371657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836123.371669:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836123.371675:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3302:x1875730538444800:12345-0@lo:103: 00010000:00010000:2.0:1788836123.371682:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836123.371686:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 14 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371695:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 14 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371705:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371713:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371728:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371735:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371742:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371749:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371760:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836123.371765:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371771:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371779:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.371789:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836123.371822:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3302:x1875730538444800:12345-0@lo:103: Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.371829:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836123.371867:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538444800:0@lo:103: 00000100:00100000:2.0:1788836123.371874:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538444672:0@lo:103: 00010000:00010000:0.0:1788836123.371952:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836123.372074:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90914d expref: 13 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.372086:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538444032:0@lo:104: 00010000:00010000:1.0:1788836123.372104:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90912a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909123 expref: 12 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.372112:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5823:1875730538444544:0@lo:104: 00010000:00010000:1.0:1788836123.372136:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.372145:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.372152:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.372159:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b9091d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836123.372172:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788836123.405418:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:7613:x1875730538443520:12345-0@lo:253: Request processed in 46843us (48206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836123.405434:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836123.405535:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538443520:0@lo:253: 10000000:01000000:0.0:1788836123.405550:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788836123.405554:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836123.405556:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836123.405557:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836123.405559:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788836123.405560:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836123.405572:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836123.405574:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836123.405576:0:7613:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788836123.405577:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836123.405579:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788836123.405600:0:7613:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd079eb5000 from lustre-OST0001 10000000:01000000:0.0:1788836123.405623:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788836123.405626:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788836123.405633:0:7613:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd046738000 local copy 10000000:01000000:0.0:1788836123.405637:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788836123.405669:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.405679:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.405688:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836123.405705:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538444928:0@lo:101: 00000100:00100000:0.0:1788836123.405740:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.405787:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06539a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.405863:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538444928 00000100:00100000:2.0:1788836123.405870:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538444928 00000100:00100000:2.0:1788836123.405912:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836123.405922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:7613:x1875730538444928:12345-0@lo:101: 00010000:00010000:2.0:1788836123.405936:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836123.405949:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9091e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9091e0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.405972:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9091e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091e0 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.405981:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9091e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091e0 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.406002:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3a00, rc 0) 00000100:00100000:2.0:1788836123.406047:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538444928:12345-0@lo:101: Request processed in 126us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.406054:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836123.406138:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538444928:0@lo:101: 00010000:00010000:1.0:1788836123.406150:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406160:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.406253:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445056:0@lo:501: 00000100:00100000:1.0:1788836123.406281:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836123.406313:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.406367:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445056 00000100:00100000:0.0:1788836123.406371:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445056 00000100:00100000:0.0:1788836123.406401:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836123.406416:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445056:12345-0@lo:501: 00000100:00100000:0.0:1788836123.406601:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445056:12345-0@lo:501: Request processed in 186us (320us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836123.406608:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788836123.406683:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445056:0@lo:501: 10000000:01000000:1.0:1788836123.406695:0:7613:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788836123.406719:0:7613:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788836123.406724:0:7613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406733:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406740:0:7613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406760:0:7613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788836123.406776:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd079eb5000 10000000:01000000:1.0:1788836123.406781:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836123.406785:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788836123.406788:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836123.406792:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788836123.406795:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836123.406820:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406828:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.406836:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.406848:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445184:0@lo:101: 00000100:00100000:1.0:1788836123.406878:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836123.406896:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1300 going to sleep for 11 seconds 00010000:00010000:0.0:1788836123.406947:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836123.406953:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.406960:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836123.406963:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.406972:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836123.406979:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836123.406984:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836123.407003:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407008:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836123.407034:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407041:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031c00/0xcb5b7bc40b9091e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcb5b7bc40b9091e7 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407054:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.407061:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.407063:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836123.407071:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836123.407081:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538445312:0@lo:103: 00000100:00100000:0.0:1788836123.407107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.407132:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445312 00000100:00100000:0.0:1788836123.407136:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445312 00000100:00100000:0.0:1788836123.407163:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836123.407169:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:3305:x1875730538445312:12345-0@lo:103: 00010000:00010000:0.0:1788836123.407178:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836123.407190:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9091e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b9091e0 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407205:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836123.407228:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:3305:x1875730538445312:12345-0@lo:103: Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.407234:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836123.407259:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538445312:0@lo:103: 00000100:00100000:0.0:1788836123.407273:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445184 00000100:00100000:0.0:1788836123.407276:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445184 00000100:00100000:0.0:1788836123.407294:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836123.407300:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+11:7613:x1875730538445184:12345-0@lo:101: 00010000:00010000:0.0:1788836123.407310:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836123.407320:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9091ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407335:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407394:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.407402:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:0.0:1788836123.407429:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445184:12345-0@lo:101: Request processed in 128us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.407436:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836123.407566:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445184:0@lo:101: 00010000:00010000:1.0:1788836123.407576:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836123.407584:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836123.407657:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445440:0@lo:501: 00000100:00100000:1.0:1788836123.407682:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836123.407710:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.407769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445440 00000100:00100000:2.0:1788836123.407774:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445440 00000100:00100000:2.0:1788836123.407814:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788836123.407821:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445440:12345-0@lo:501: 00000100:00100000:2.0:1788836123.408045:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445440:12345-0@lo:501: Request processed in 224us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.408053:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788836123.408086:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445440:0@lo:501: 00000100:00100000:2.0:1788836123.408113:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445568:0@lo:503: 00000100:00100000:2.0:1788836123.408146:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.408159:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.408172:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445568 00000100:00100000:2.0:1788836123.408176:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445568 00000100:00100000:2.0:1788836123.408192:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836123.408197:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445568:12345-0@lo:503: 00000100:00100000:2.0:1788836123.408327:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445568:12345-0@lo:503: Request processed in 129us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.408335:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836123.408399:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445568:0@lo:503: 00000040:00080000:2.0:1788836123.408643:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836123.408720:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445696:0@lo:502: 00000100:00100000:2.0:1788836123.408754:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.408768:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.408785:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445696 00000100:00100000:2.0:1788836123.408788:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445696 00000100:00100000:2.0:1788836123.408820:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836123.408827:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445696:12345-0@lo:502: 00000100:00100000:2.0:1788836123.408961:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445696:12345-0@lo:502: Request processed in 134us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.408967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836123.409005:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445696:0@lo:502: 00000040:00080000:2.0:1788836123.409210:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788836123.409254:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788836123.409286:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788836123.409365:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788836123.409404:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788836123.409434:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788836123.409457:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445824:0@lo:502: 00000100:00100000:2.0:1788836123.409492:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.409507:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.409523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445824 00000100:00100000:2.0:1788836123.409527:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445824 00000100:00100000:2.0:1788836123.409546:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788836123.409552:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445824:12345-0@lo:502: 00000100:00100000:2.0:1788836123.409670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445824:12345-0@lo:502: Request processed in 117us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.409677:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788836123.409719:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445824:0@lo:502: 00000040:00080000:2.0:1788836123.409803:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788836123.409826:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788836123.410770:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788836123.410779:0:7619:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788836123.410785:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836123.410788:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788836123.410794:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836123.410817:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd07b234d28) 00000020:00000080:1.0:1788836123.410840:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788836123.410846:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836123.410928:0:7619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd079eb5000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788836123.410936:0:7619:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836123.410945:0:7619:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b909203 00010000:00010000:2.0:1788836123.412968:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836123.414028:0:7619:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788836123.414546:0:7619:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788836123.416725:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788836123.417011:0:7619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788836123.421194:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788836123.421680:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788836123.422957:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788836123.422974:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836123.422979:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836123.422982:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788836123.422985:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836123.422989:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836123.422990:0:7619:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836123.422993:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836123.422996:0:7619:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836123.423046:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836123.423049:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836123.423051:0:7619:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788836123.423054:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788836123.427372:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788836123.427415:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788836123.427433:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.427446:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836123.427454:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd079eb5000 from 1 10000000:01000000:3.0:1788836123.427457:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836123.427494:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.427503:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.427514:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836123.427535:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445952:0@lo:101: 00000100:00100000:3.0:1788836123.427672:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.427719:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.427791:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538445952 00000100:00100000:0.0:1788836123.427798:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538445952 00000100:00100000:0.0:1788836123.427853:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788836123.427862:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:7613:x1875730538445952:12345-0@lo:101: 00010000:00010000:0.0:1788836123.427875:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836123.427886:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90920a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.427909:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.427920:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.427928:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031c00, rc 0) 00000100:00100000:0.0:1788836123.427974:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538445952:12345-0@lo:101: Request processed in 113us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.427981:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836123.428072:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538445952:0@lo:101: 00010000:00010000:3.0:1788836123.428095:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.428104:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836123.428193:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446080:0@lo:501: 00000100:00100000:3.0:1788836123.428217:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.428331:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.434017:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446080 00000100:00100000:0.0:1788836123.434031:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446080 00000100:00100000:0.0:1788836123.434192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836123.434215:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446080:12345-0@lo:501: 00000100:00100000:0.0:1788836123.434531:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446080:12345-0@lo:501: Request processed in 315us (6311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.434539:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836123.434665:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446080:0@lo:501: 00000100:00100000:3.0:1788836123.434712:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446208:0@lo:503: 00000100:00100000:3.0:1788836123.434755:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.434979:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.435043:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446208 00000100:00100000:0.0:1788836123.435049:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446208 00000100:00100000:0.0:1788836123.435070:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788836123.435076:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446208:12345-0@lo:503: 00000100:00100000:0.0:1788836123.435418:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446208:12345-0@lo:503: Request processed in 340us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.435427:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836123.435523:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446208:0@lo:503: 00000040:00080000:3.0:1788836123.435789:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836123.435872:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446336:0@lo:502: 00000100:00100000:3.0:1788836123.435910:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.435941:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.436064:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446336 00000100:00100000:0.0:1788836123.436069:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446336 00000100:00100000:0.0:1788836123.436090:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788836123.436097:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446336:12345-0@lo:502: 00000100:00100000:0.0:1788836123.436245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446336:12345-0@lo:502: Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.436252:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788836123.436326:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446336:0@lo:502: 00000040:00080000:3.0:1788836123.436683:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788836123.436732:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788836123.436757:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446464:0@lo:502: 00000100:00100000:3.0:1788836123.436796:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.436912:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836123.436972:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446464 00000100:00100000:1.0:1788836123.436978:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446464 00000100:00100000:0.0:1788836123.437025:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836123.437033:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446464:12345-0@lo:502: 00000100:00100000:0.0:1788836123.437164:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446464:12345-0@lo:502: Request processed in 131us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.437171:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788836123.437295:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446464:0@lo:502: 00000040:00080000:3.0:1788836123.437414:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788836123.437424:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788836123.437910:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836123.437919:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836123.437921:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836123.437928:0:7623:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd079eb5000 00000020:00000080:3.0:1788836123.437931:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836123.437948:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836123.437951:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836123.437953:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788836123.437956:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788836123.438206:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788836123.438226:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836123.438276:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.438287:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836123.438330:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836123.438333:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd079eb5000 10000000:01000000:2.0:1788836123.438336:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd079eb5000 10000000:01000000:2.0:1788836123.438368:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836123.438374:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd079eb5000 from 1 10000000:01000000:2.0:1788836123.438376:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836123.438405:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.438413:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.438422:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.438438:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446592:0@lo:101: 00000100:00100000:2.0:1788836123.438483:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.438521:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.438674:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446592 00000100:00100000:0.0:1788836123.438680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446592 00000100:00100000:0.0:1788836123.438720:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836123.438729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538446592:12345-0@lo:101: 00010000:00010000:0.0:1788836123.438748:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836123.438761:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909218 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.438784:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.438794:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.438802:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030c00, rc 0) 00000100:00100000:0.0:1788836123.438856:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446592:12345-0@lo:101: Request processed in 128us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.438862:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788836123.438934:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446592:0@lo:101: 00010000:00010000:2.0:1788836123.438953:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.438961:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.439049:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446720:0@lo:501: 00000100:00100000:2.0:1788836123.439074:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.439102:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.439148:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446720 00000100:00100000:0.0:1788836123.439152:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446720 00000100:00100000:0.0:1788836123.439180:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836123.439187:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446720:12345-0@lo:501: 00000100:00100000:0.0:1788836123.439434:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446720:12345-0@lo:501: Request processed in 247us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.439442:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788836123.439589:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446720:0@lo:501: 00000100:00100000:2.0:1788836123.439616:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446848:0@lo:503: 00000100:00100000:2.0:1788836123.439653:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.439664:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.439774:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446848 00000100:00100000:0.0:1788836123.439779:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446848 00000100:00100000:0.0:1788836123.439820:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836123.439827:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446848:12345-0@lo:503: 00000100:00100000:0.0:1788836123.439972:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446848:12345-0@lo:503: Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.439979:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836123.440022:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446848:0@lo:503: 00000040:00080000:0.0:1788836123.440271:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836123.440336:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446976:0@lo:502: 00000100:00100000:0.0:1788836123.440401:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.440424:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06539aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836123.440439:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538446976 00000100:00100000:0.0:1788836123.440443:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538446976 00000100:00100000:0.0:1788836123.440462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836123.440467:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446976:12345-0@lo:502: 00000100:00100000:0.0:1788836123.440954:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538446976:12345-0@lo:502: Request processed in 485us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.440962:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788836123.441109:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538446976:0@lo:502: 00000040:00080000:2.0:1788836123.441833:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788836123.441892:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788836123.441925:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788836123.441971:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788836123.442014:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788836123.442076:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788836123.442116:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788836123.442149:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788836123.442197:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788836123.442235:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788836123.442281:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788836123.442331:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788836123.442522:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788836123.442556:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788836123.442695:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788836123.442732:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788836123.442767:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788836123.442824:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788836123.442856:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788836123.442888:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788836123.442935:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788836123.442969:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788836123.443002:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788836123.443049:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788836123.443081:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788836123.443108:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788836123.443164:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788836123.443200:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788836123.443229:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788836123.443294:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788836123.443331:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788836123.443645:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788836123.443678:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788836123.443720:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788836123.443747:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788836123.443786:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788836123.443825:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788836123.443868:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538447104:0@lo:502: 00000100:00100000:2.0:1788836123.443937:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836123.444007:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047c3c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836123.444051:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447104 00000100:00100000:1.0:1788836123.444059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447104 00000100:00100000:1.0:1788836123.444134:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836123.444143:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538447104:12345-0@lo:502: 00000100:00100000:1.0:1788836123.444378:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538447104:12345-0@lo:502: Request processed in 235us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836123.444385:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788836123.444473:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538447104:0@lo:502: 00000040:00080000:0.0:1788836123.444541:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788836123.444551:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788836123.445119:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788836123.445135:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd07d3799b8) 00000020:00000080:0.0:1788836123.445154:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788836123.445217:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd079eb5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836123.445221:0:7624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd079eb5000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836123.445224:0:7624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd079eb5000 3 00010000:00080000:0.0:1788836123.445252:0:7624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07afa0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788836123.446913:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788836123.448650:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788836123.448691:0:7624:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836123.448703:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcb5b7bc40b90922d 00000100:00080000:0.0:1788836123.448713:0:7624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836123.448719:0:7624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd07afa0000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836123.448763:0:7624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd0454b9500 x1875730538447232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836123.448802:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538447232:0@lo:38: 00000100:00080000:2.0:1788836123.449481:0:7624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788836123.449621:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836123.449636:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538447360:0@lo:400: 00000100:00100000:3.0:1788836123.449698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.449736:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538447488:0@lo:400: 00000100:00100000:3.0:1788836123.449758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.449777:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836123.449782:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538447616:0@lo:400: 00000100:00100000:3.0:1788836123.449816:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.449848:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447360 00000100:00100000:3.0:1788836123.449856:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447360 00000100:00100000:3.0:1788836123.449896:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447488 00000100:00100000:3.0:1788836123.449899:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447488 00000100:00100000:3.0:1788836123.449924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836123.449932:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538447360:12345-0@lo:400: 00000100:00100000:3.0:1788836123.449982:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538447360:12345-0@lo:400: Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836123.449989:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836123.450006:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836123.450019:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538447488:12345-0@lo:400: 00000100:00100000:3.0:1788836123.450050:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538447488:12345-0@lo:400: Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836123.450056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788836123.450092:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674c000 x1875730538447488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836123.450105:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538447488:0@lo:400: 00010000:00080000:3.0:1788836123.450129:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674f800 x1875730538447360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836123.450138:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538447360:0@lo:400: 00000040:00080000:3.0:1788836123.450671:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788836123.450759:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788836123.450784:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836123.450799:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.450819:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788836123.450878:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788836123.450880:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836123.450882:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836123.450883:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836123.450884:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836123.450886:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836123.450887:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836123.450888:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836123.450890:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836123.450891:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836123.450893:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836123.450901:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788836123.450903:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836123.450904:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836123.450905:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836123.450906:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836123.450907:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836123.450908:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836123.450909:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836123.450910:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836123.450911:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836123.450912:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836123.450913:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836123.450929:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836123.450942:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538447744:0@lo:253: 00000100:00100000:3.0:1788836123.450983:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836123.451012:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1788836123.451146:0:7626:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9bd07b256680 x1875730538447872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836123.451155:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047c3c3c0 going to sleep for 0 seconds 00000100:00100000:0.0:1788836123.457600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.457669:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447616 00000100:00100000:0.0:1788836123.457678:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447616 00000100:00100000:0.0:1788836123.457726:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836123.457736:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538447616:12345-0@lo:400: 00000100:00100000:0.0:1788836123.457791:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538447616:12345-0@lo:400: Request processed in 57us (7985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.457798:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836123.457832:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447232 00000100:00100000:0.0:1788836123.457837:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447232 00000100:00100000:0.0:1788836123.457856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836123.457861:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875730538447232:12345-0@lo:38: 00010000:00080000:0.0:1788836123.457880:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1788836123.457917:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcb5b7bc40b909234 00000004:00100000:0.0:1788836123.457932:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836123.457961:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836123.457999:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875730538447232:12345-0@lo:38: Request processed in 137us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.458006:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788836123.458024:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836123.458030:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836123.458039:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447744 00000100:00100000:0.0:1788836123.458043:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447744 00000100:00100000:0.0:1788836123.458069:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836123.458076:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:7613:x1875730538447744:12345-0@lo:253: 20000000:01000000:0.0:1788836123.458106:0:5822:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788836123.458119:0:5822:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788836123.458891:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd04674df80 x1875730538447616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836123.458906:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538447616:0@lo:400: 00010000:00080000:0.0:1788836123.458940:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd0454b9500 x1875730538447232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836123.458948:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836123.458955:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788836123.458962:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836123.458967:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836123.458970:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788836123.458976:0:3301:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000042edc5f4): req@ffff9bd07b256680 x1875730538447872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836123.458991:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538447232:0@lo:38: 00000100:00100000:0.0:1788836123.459044:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.459075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538447872 00000100:00100000:0.0:1788836123.459079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538447872 00000100:00100000:0.0:1788836123.459112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836123.459119:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875730538447872:12345-0@lo:901: 00000100:00100000:0.0:1788836123.459432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875730538447872:12345-0@lo:901: Request processed in 312us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836123.459439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788836123.459457:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788836123.459477:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07b256680 x1875730538447872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788836139 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836123.459499:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1875730538447872:0@lo:901: 20000000:01000000:2.0:1788836123.486020:0:5822:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788836123.486052:0:5822:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788836123.486114:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788836123.486119:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788836123.486139:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.486157:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.486167:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.486205:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.486220:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 14 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836123.486234:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538448000:0@lo:104: 00000100:00100000:0.0:1788836123.486299:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.486380:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836123.486389:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448000 00000100:00100000:2.0:1788836123.486398:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448000 00000100:00100000:2.0:1788836123.486451:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836123.486461:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538448000:12345-0@lo:104: 00010000:00010000:2.0:1788836123.486474:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.486526:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836123.486532:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:5845:x1875730538448000:12345-0@lo:104: Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.486539:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788836123.488274:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836123.488287:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.488299:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836123.488303:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.488328:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836123.488335:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836123.488367:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836123.488405:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.488413:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836123.488439:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.488446:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060377600/0xcb5b7bc40b909185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90918c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836123.488465:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.488467:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836123.488469:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836123.488477:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836123.488496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538448128:0@lo:103: 00000100:00100000:0.0:1788836123.488555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836123.488619:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1875730538448000:0@lo:104: 00000100:00100000:2.0:1788836123.488629:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448128 00000100:00100000:2.0:1788836123.488638:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448128 00010000:00010000:0.0:1788836123.488641:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488667:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.488713:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836123.488722:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3305:x1875730538448128:12345-0@lo:103: 00010000:00010000:2.0:1788836123.488736:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836123.488742:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488755:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488771:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90918c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909185 expref: 15 pid: 5822 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488786:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488802:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788836123.488829:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002710513s 00010000:00010000:2.0:1788836123.488834:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488841:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488847:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488853:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488859:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836123.488862:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488869:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488891:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836123.488901:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836123.488953:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047944850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3305:x1875730538448128:12345-0@lo:103: Request processed in 232us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.488962:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836123.488970:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538448128:0@lo:103: 00010000:00010000:3.0:1788836123.489052:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.489062:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836123.489069:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90923b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836123.500716:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:7613:x1875730538447744:12345-0@lo:253: Request processed in 42629us (49721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836123.500731:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788836123.500825:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8e83d0f-78a2-4253-8765-c02f0116c7a1:7613:1875730538447744:0@lo:253: 10000000:01000000:3.0:1788836123.500840:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836123.500844:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836123.500846:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836123.500847:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836123.500849:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836123.500850:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836123.500851:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836123.500853:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836123.500854:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788836123.500978:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788836123.500980:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836123.500981:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788836123.500996:0:7613:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788836123.506043:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836123.506241:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836123.506490:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836123.506743:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836123.507128:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836123.507549:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788836123.508480:0:7613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788836123.701153:0:7613:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788836123.701160:0:7613:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788836123.701193:0:7613:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836123.701245:0:7613:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836123.701265:0:7613:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788836123.701290:0:7613:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788836124.434835:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836125.456504:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836126.486005:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836126.547207:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538448256:0@lo:13: 00000100:00100000:1.0:1788836126.547276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836126.547440:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448256 00000100:00100000:2.0:1788836126.547448:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448256 00000100:00100000:2.0:1788836126.547510:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836126.547521:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538448256:12345-0@lo:13: 00002000:00000024:2.0:1788836126.547554:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836126.547608:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538448256:12345-0@lo:13: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836126.547616:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788836126.547676:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836126.547708:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b255f80 x1875730538448256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836126.547726:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538448256:0@lo:13: 00010000:00010000:0.0:1788836127.507941:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836128.528684:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836128.592782:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538448512:0@lo:400: 00000100:00100000:1.0:1788836128.592862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836128.592871:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538448384:0@lo:400: 00000100:00100000:3.0:1788836128.592916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836128.592937:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538448640:0@lo:400: 00000100:00100000:3.0:1788836128.592950:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538448896:0@lo:400: 00000100:00100000:1.0:1788836128.592981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836128.593008:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836128.593015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538448768:0@lo:400: 00000100:00100000:3.0:1788836128.593021:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836128.595401:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448384 00000100:00100000:2.0:1788836128.595414:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448384 00000100:00100000:2.0:1788836128.595470:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836128.595479:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3302:x1875730538448384:12345-0@lo:400: 00000100:00100000:1.0:1788836128.597000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836128.597049:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448768 00000100:00100000:0.0:1788836128.597058:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448768 00000100:00100000:1.0:1788836128.597066:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448512 00000100:00100000:1.0:1788836128.597072:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448512 00000100:00100000:1.0:1788836128.597109:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448640 00000100:00100000:1.0:1788836128.597112:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448640 00000100:00100000:0.0:1788836128.597118:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836128.597130:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538448768:12345-0@lo:400: 00000100:00100000:1.0:1788836128.597131:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538448896 00000100:00100000:1.0:1788836128.597135:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538448896 00000100:00100000:1.0:1788836128.597153:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836128.597161:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538448512:12345-0@lo:400: 00000100:00100000:1.0:1788836128.597211:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538448512:12345-0@lo:400: Request processed in 51us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836128.597217:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836128.597232:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836128.597239:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538448640:12345-0@lo:400: 00000100:00100000:0.0:1788836128.597272:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538448768:12345-0@lo:400: Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836128.597280:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538448640:12345-0@lo:400: Request processed in 41us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836128.597283:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836128.597292:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788836128.597307:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836128.597311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788836128.597314:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836128.597321:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538448896:12345-0@lo:400: 00000100:00100000:1.0:1788836128.597381:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538448896:12345-0@lo:400: Request processed in 63us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836128.597387:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788836128.597434:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb7480 x1875730538448512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836128.597448:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538448512:0@lo:400: 00010000:00080000:1.0:1788836128.597547:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb5f80 x1875730538448896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836128.597556:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538448896:0@lo:400: 00010000:00080000:0.0:1788836128.598000:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb7b80 x1875730538448768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836128.598013:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538448768:0@lo:400: 00010000:00080000:0.0:1788836128.598026:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb5880 x1875730538448640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836128.598035:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538448640:0@lo:400: 00000100:00100000:2.0:1788836128.598333:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3302:x1875730538448384:12345-0@lo:400: Request processed in 2853us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836128.598462:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538448384:0@lo:400: 00000100:00100000:2.0:1788836128.599106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000001:02000400:0.0:1788836128.640827:0:7967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788836129.553038:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836130.576571:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836131.600933:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836131.667672:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788836131.667681:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd078fee000 from 30 10000000:01000000:3.0:1788836131.667686:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788836131.667733:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.667744:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.667765:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.667790:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449024:0@lo:101: 00000100:00100000:3.0:1788836131.667861:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.667908:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836131.667978:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449024 00000100:00100000:1.0:1788836131.667987:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449024 00000100:00100000:1.0:1788836131.668034:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788836131.668055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538449024:12345-0@lo:101: 00010000:00010000:1.0:1788836131.668070:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836131.668082:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909242 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.668103:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.668114:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.668123:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376600, rc 0) 00000100:00100000:1.0:1788836131.668162:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449024:12345-0@lo:101: Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836131.668169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788836131.669453:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538449152:0@lo:13: 00000100:00100000:1.0:1788836131.669503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.669592:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449024:0@lo:101: 00010000:00010000:3.0:1788836131.669664:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836131.669682:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449152 00010000:00010000:3.0:1788836131.669688:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836131.669688:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449152 00000100:00100000:0.0:1788836131.669732:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836131.669739:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449280:0@lo:501: 00000100:00100000:0.0:1788836131.669740:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538449152:12345-0@lo:13: 00000100:00100000:3.0:1788836131.669779:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788836131.669779:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836131.669802:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.669816:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449280 00000100:00100000:3.0:1788836131.669823:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449280 00000100:00100000:3.0:1788836131.669849:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836131.669855:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449280:12345-0@lo:501: 00000100:00100000:3.0:1788836131.670296:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449280:12345-0@lo:501: Request processed in 439us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.670304:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836131.670364:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449280:0@lo:501: 00000100:00100000:3.0:1788836131.670393:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449408:0@lo:503: 00000100:00100000:3.0:1788836131.670431:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.670446:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.670459:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449408 00000100:00100000:3.0:1788836131.670463:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449408 00000100:00100000:3.0:1788836131.670489:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788836131.670495:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449408:12345-0@lo:503: 00000100:00100000:3.0:1788836131.672145:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449408:12345-0@lo:503: Request processed in 1643us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.672157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788836131.672232:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449408:0@lo:503: 00000100:00100000:3.0:1788836131.672433:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8082:1875730538449536:0@lo:502: 00000100:00100000:3.0:1788836131.672475:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.672498:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449536 00000100:00100000:3.0:1788836131.672503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449536 00000100:00100000:3.0:1788836131.672530:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836131.672537:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8082:x1875730538449536:12345-0@lo:502: 00000100:00100000:3.0:1788836131.672926:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8082:x1875730538449536:12345-0@lo:502: Request processed in 388us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.672933:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836131.672967:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.672980:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8082:1875730538449536:0@lo:502: 00000100:00100000:3.0:1788836131.673020:0:8082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8082:1875730538449664:0@lo:502: 00000100:00100000:3.0:1788836131.673130:0:8082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.673152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449664 00000100:00100000:3.0:1788836131.673157:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449664 00000100:00100000:3.0:1788836131.673179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836131.673186:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8082:x1875730538449664:12345-0@lo:502: 00000100:00100000:3.0:1788836131.673306:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8082:x1875730538449664:12345-0@lo:502: Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.673313:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836131.673356:0:8082:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.673368:0:8082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8082:1875730538449664:0@lo:502: 00000040:00080000:3.0:1788836131.673386:0:8082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788836131.673434:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788836131.673448:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836131.673458:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673475:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836131.673485:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788836131.673488:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788836131.673490:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836131.673514:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673522:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673531:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.673543:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449792:0@lo:101: 00000100:00100000:3.0:1788836131.673570:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.673585:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.673596:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449792 00000100:00100000:3.0:1788836131.673599:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449792 00000100:00100000:3.0:1788836131.673632:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836131.673638:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538449792:12345-0@lo:101: 00010000:00010000:3.0:1788836131.673646:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836131.673657:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909250 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673677:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673697:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673706:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d600, rc 0) 00000100:00100000:3.0:1788836131.673735:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538449792:12345-0@lo:101: Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.673740:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836131.673781:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449792:0@lo:101: 00010000:00010000:3.0:1788836131.673793:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.673800:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.673836:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449920:0@lo:501: 00000100:00100000:3.0:1788836131.673858:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.673870:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.673879:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538449920 00000100:00100000:3.0:1788836131.673882:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538449920 00000100:00100000:3.0:1788836131.673899:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836131.673904:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538449920:12345-0@lo:501: 00000100:00100000:3.0:1788836131.674263:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538449920:12345-0@lo:501: Request processed in 358us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.674269:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836131.674298:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538449920:0@lo:501: 00000100:00100000:3.0:1788836131.674322:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450048:0@lo:503: 00000100:00100000:3.0:1788836131.674382:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.674395:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.674406:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450048 00000100:00100000:3.0:1788836131.674409:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450048 00000100:00100000:3.0:1788836131.674429:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788836131.674435:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538450048:12345-0@lo:503: 00000100:00100000:3.0:1788836131.674780:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538450048:12345-0@lo:503: Request processed in 344us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.674787:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788836131.674823:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450048:0@lo:503: 00000100:00100000:3.0:1788836131.675194:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8083:1875730538450176:0@lo:502: 00000100:00100000:3.0:1788836131.675231:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.675251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450176 00000100:00100000:3.0:1788836131.675255:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450176 00000100:00100000:3.0:1788836131.675275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836131.675281:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8083:x1875730538450176:12345-0@lo:502: 00000100:00100000:3.0:1788836131.675457:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8083:x1875730538450176:12345-0@lo:502: Request processed in 174us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.675463:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836131.675494:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.675505:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8083:1875730538450176:0@lo:502: 00000020:01000000:3.0:1788836131.675525:0:8083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836131.675532:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836131.675535:0:8083:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788836131.675539:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788836131.675541:0:8083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788836131.675555:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8083:1875730538450304:0@lo:502: 00000100:00100000:3.0:1788836131.675589:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.676003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450304 00000100:00100000:3.0:1788836131.676008:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450304 00000100:00100000:3.0:1788836131.676032:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788836131.676039:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8083:x1875730538450304:12345-0@lo:502: 00000100:00100000:3.0:1788836131.676237:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8083:x1875730538450304:12345-0@lo:502: Request processed in 198us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.676243:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788836131.676273:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046706540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.676286:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8083:1875730538450304:0@lo:502: 00000020:01000000:3.0:1788836131.676304:0:8083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788836131.676307:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538449152:12345-0@lo:13: Request processed in 6566us (6802us total) trans 0 rc 0/0 00000020:00000080:3.0:1788836131.676308:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836131.676310:0:8083:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788836131.676313:0:8083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000100:00100000:0.0:1788836131.676321:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788836131.676357:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788836131.676382:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 00010000:00080000:1.0:1788836131.676498:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd04674ed80 x1875730538449152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836131.676523:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538449152:0@lo:13: 10000000:01000000:0.0:1788836131.676885:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788836131.676894:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836131.676905:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836131.676915:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788836131.676917:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd0497a5800 from 30 10000000:01000000:0.0:1788836131.676920:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836131.676946:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836131.676954:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836131.676963:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836131.676978:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450432:0@lo:101: 00000100:00100000:0.0:1788836131.677011:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.677046:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04868fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.677130:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450432 00000100:00100000:3.0:1788836131.677135:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450432 00000100:00100000:3.0:1788836131.677171:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788836131.677177:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538450432:12345-0@lo:101: 00010000:00010000:3.0:1788836131.677186:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836131.677198:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90925e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.677218:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.677229:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.677237:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836131.677323:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538450432:12345-0@lo:101: Request processed in 146us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.677330:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836131.679802:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450432:0@lo:101: 00010000:00010000:1.0:1788836131.679828:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.679841:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836131.679934:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450560:0@lo:501: 00000100:00100000:1.0:1788836131.679988:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836131.680039:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048a2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836131.680099:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450560 00000100:00100000:0.0:1788836131.680106:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450560 00000100:00100000:0.0:1788836131.680161:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836131.680171:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538450560:12345-0@lo:501: 00000100:00100000:0.0:1788836131.680864:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538450560:12345-0@lo:501: Request processed in 692us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836131.680872:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788836131.685745:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450560:0@lo:501: 00000100:00100000:1.0:1788836131.685814:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450688:0@lo:503: 00000100:00100000:1.0:1788836131.686169:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836131.686216:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048a2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836131.686810:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450688 00000100:00100000:0.0:1788836131.686819:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450688 00000100:00100000:0.0:1788836131.686870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836131.686879:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538450688:12345-0@lo:503: 00000100:00100000:0.0:1788836131.687137:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538450688:12345-0@lo:503: Request processed in 258us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836131.687280:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836131.687338:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538450688:0@lo:503: 00000100:00100000:2.0:1788836131.693064:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8085:1875730538450816:0@lo:502: 00000100:00100000:2.0:1788836131.693691:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836131.693888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450816 00000100:00100000:1.0:1788836131.693896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450816 00000100:00100000:1.0:1788836131.693953:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788836131.693965:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8085:x1875730538450816:12345-0@lo:502: 00000100:00100000:1.0:1788836131.694721:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8085:x1875730538450816:12345-0@lo:502: Request processed in 755us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836131.694730:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788836131.694870:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836131.694900:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8085:1875730538450816:0@lo:502: 00000100:00100000:0.0:1788836131.694964:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8085:1875730538450944:0@lo:502: 00000100:00100000:0.0:1788836131.695005:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.695036:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04868fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836131.696328:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538450944 00000100:00100000:2.0:1788836131.696338:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538450944 00000100:00100000:2.0:1788836131.696409:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788836131.696418:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8085:x1875730538450944:12345-0@lo:502: 00000100:00100000:2.0:1788836131.696712:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8085:x1875730538450944:12345-0@lo:502: Request processed in 294us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836131.696720:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788836131.698617:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8085:1875730538450944:0@lo:502: 00000040:00080000:1.0:1788836131.698659:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788836131.699565:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788836131.699609:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836131.699620:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836131.699631:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836131.699640:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836131.699642:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd0497a5800 from 5 10000000:01000000:2.0:1788836131.699645:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836131.699681:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836131.699690:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836131.699707:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836131.699729:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451072:0@lo:101: 00000100:00100000:2.0:1788836131.699802:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.699839:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836131.700323:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451072 00000100:00100000:1.0:1788836131.700332:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451072 00000100:00100000:1.0:1788836131.700417:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788836131.700425:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538451072:12345-0@lo:101: 00010000:00010000:1.0:1788836131.700450:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836131.700469:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377600/0xcb5b7bc40b909273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90926c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.700492:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377600/0xcb5b7bc40b909273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90926c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.700503:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377600/0xcb5b7bc40b909273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90926c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.700512:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377600, rc 0) 00000100:00100000:1.0:1788836131.700560:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538451072:12345-0@lo:101: Request processed in 135us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836131.700566:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836131.701724:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451072:0@lo:101: 00010000:00010000:2.0:1788836131.701746:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836131.701766:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836131.701830:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451200:0@lo:256: 00000100:00100000:2.0:1788836131.701879:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.701917:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836131.702232:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451200 00000100:00100000:1.0:1788836131.702239:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451200 00000100:00100000:1.0:1788836131.702280:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788836131.702287:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538451200:12345-0@lo:256: 20000000:01000000:1.0:1788836131.702305:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788836131.702321:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788836131.702324:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788836131.702434:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538451200:12345-0@lo:256: Request processed in 148us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836131.702453:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788836131.702583:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451200:0@lo:256: 10000000:01000000:3.0:1788836131.702697:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836131.702705:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.702714:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836131.702723:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788836131.702725:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788836131.702728:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836131.702750:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.702767:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.702776:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.702788:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451328:0@lo:101: 00000100:00100000:3.0:1788836131.702817:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.702840:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836131.703321:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451328 00000100:00100000:1.0:1788836131.703335:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451328 00000100:00100000:1.0:1788836131.703398:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836131.703405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538451328:12345-0@lo:101: 00010000:00010000:1.0:1788836131.703415:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836131.703427:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90927a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.703460:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.703469:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836131.703478:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377400, rc 0) 00000100:00100000:1.0:1788836131.703513:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538451328:12345-0@lo:101: Request processed in 109us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836131.703519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788836131.703706:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451328:0@lo:101: 00010000:00010000:3.0:1788836131.703720:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.703740:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.703804:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451456:0@lo:501: 00000100:00100000:3.0:1788836131.703833:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.703866:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.703879:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451456 00000100:00100000:3.0:1788836131.703883:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451456 00000100:00100000:3.0:1788836131.703901:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788836131.703907:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538451456:12345-0@lo:501: 00000100:00100000:3.0:1788836131.704232:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538451456:12345-0@lo:501: Request processed in 323us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.704239:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788836131.704272:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451456:0@lo:501: 00000100:00100000:3.0:1788836131.704296:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451584:0@lo:503: 00000100:00100000:3.0:1788836131.704583:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.704673:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.704686:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451584 00000100:00100000:3.0:1788836131.704690:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451584 00000100:00100000:3.0:1788836131.704709:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836131.704715:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538451584:12345-0@lo:503: 00000100:00100000:3.0:1788836131.705026:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538451584:12345-0@lo:503: Request processed in 311us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.705033:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836131.705075:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538451584:0@lo:503: 00000100:00100000:3.0:1788836131.708071:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8086:1875730538451712:0@lo:502: 00000100:00100000:3.0:1788836131.708241:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.708283:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451712 00000100:00100000:3.0:1788836131.708290:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451712 00000100:00100000:3.0:1788836131.708332:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836131.708354:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8086:x1875730538451712:12345-0@lo:502: 00000100:00100000:3.0:1788836131.711997:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8086:x1875730538451712:12345-0@lo:502: Request processed in 3647us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.712207:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836131.712279:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.712305:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8086:1875730538451712:0@lo:502: 00000020:01000000:3.0:1788836131.712339:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836131.712369:0:8086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788836131.712376:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836131.712378:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788836131.712383:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836131.712386:0:8086:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788836131.716288:0:8086:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788836131.716296:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836131.716313:0:8086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd07b2b4d28) 00000020:00000080:3.0:1788836131.716352:0:8086:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788836131.716359:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836131.716454:0:8086:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788836131.716461:0:8086:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788836131.716467:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90928f 00010000:00080000:3.0:1788836131.716500:0:8086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bcf448a7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836131.716827:0:8086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788836131.717126:0:8086:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788836131.717143:0:8086:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788836131.719872:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836131.721770:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836131.721841:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788836131.721902:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788836131.765359:0:8089:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836131.765368:0:8089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788836131.767915:0:8086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836131.767931:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836131.767969:0:8086:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788836131.767993:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b909296 00000100:00080000:2.0:1788836131.768005:0:8086:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836131.768011:0:8086:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bcf448a7000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836131.768051:0:8086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07b255180 x1875730538451840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836131.768109:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538451840:0@lo:8: 00000100:00100000:1.0:1788836131.768248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.768400:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451840 00000100:00100000:0.0:1788836131.768407:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451840 00000100:00100000:0.0:1788836131.768449:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836131.768456:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538451840:12345-0@lo:8: 00010000:00080000:0.0:1788836131.768479:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788836131.768518:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90929d 00002000:00100000:0.0:1788836131.768531:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd07afa2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788836131.768535:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788836131.768538:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788836131.769770:0:8086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788836131.769854:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836131.769866:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836131.769868:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788836131.769873:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836131.769877:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836131.769879:0:8086:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836131.769882:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836131.769884:0:8086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788836131.769921:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8086:1875730538451968:0@lo:502: 00000100:00100000:2.0:1788836131.769994:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.770034:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048669e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836131.770102:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538452224:0@lo:400: 00000100:00100000:2.0:1788836131.770132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.770166:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836131.770172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538452096:0@lo:400: 00000100:00100000:2.0:1788836131.770192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.770211:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836131.770219:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538452352:0@lo:400: 00000100:00100000:2.0:1788836131.770254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.770282:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452224 00000100:00100000:2.0:1788836131.770289:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452224 00000100:00100000:2.0:1788836131.770330:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452096 00000100:00100000:2.0:1788836131.770333:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452096 00000100:00100000:2.0:1788836131.770364:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452352 00000100:00100000:2.0:1788836131.770366:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452352 00000100:00100000:2.0:1788836131.770382:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836131.770389:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538452224:12345-0@lo:400: 00000100:00100000:2.0:1788836131.770433:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538452224:12345-0@lo:400: Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836131.770564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836131.770581:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836131.770668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538452096:12345-0@lo:400: 00000100:00100000:2.0:1788836131.770699:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538452096:12345-0@lo:400: Request processed in 108us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836131.770706:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836131.770719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836131.770725:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538452352:12345-0@lo:400: 00000100:00100000:2.0:1788836131.770765:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538452352:12345-0@lo:400: Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836131.770772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788836131.770810:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b257100 x1875730538452096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836131.770824:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538452096:0@lo:400: 00010000:00080000:2.0:1788836131.770834:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b254700 x1875730538452224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836131.770842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538452224:0@lo:400: 00010000:00080000:2.0:1788836131.770869:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b254e00 x1875730538452352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836131.770876:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538452352:0@lo:400: 00000100:00100000:3.0:1788836131.771018:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538451968 00000100:00100000:3.0:1788836131.771023:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538451968 00000100:00100000:3.0:1788836131.771056:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788836131.771063:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8086:x1875730538451968:12345-0@lo:502: 00000100:00100000:3.0:1788836131.771763:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8086:x1875730538451968:12345-0@lo:502: Request processed in 686us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.771773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788836131.772529:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8086:1875730538451968:0@lo:502: 00000020:01000000:2.0:1788836131.772563:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836131.772570:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836131.772573:0:8086:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788836131.772577:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00100000:0.0:1788836131.772991:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788836131.773152:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836131.773180:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa1000 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1788836131.773369:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788836131.773389:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788836131.773399:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773409:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836131.773418:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788836131.773421:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd046738000 from 1 10000000:01000000:3.0:1788836131.773424:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836131.773463:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773472:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773480:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.773510:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538452480:0@lo:101: 00000100:00100000:3.0:1788836131.773551:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.773588:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048613480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.773739:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452480 00000100:00100000:3.0:1788836131.773745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452480 00000100:00100000:3.0:1788836131.773797:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836131.773805:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538452480:12345-0@lo:101: 00010000:00010000:3.0:1788836131.773815:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836131.773828:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9092a4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773850:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773859:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773867:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c200, rc 0) 00000100:00100000:3.0:1788836131.773900:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538452480:12345-0@lo:101: Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836131.773906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836131.773940:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538452480:0@lo:101: 00010000:00010000:3.0:1788836131.773953:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836131.773961:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836131.774018:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538452608:0@lo:501: 00000100:00100000:3.0:1788836131.774042:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.774056:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048613480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.774068:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452608 00000100:00100000:3.0:1788836131.774071:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452608 00000100:00100000:3.0:1788836131.774094:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836131.774100:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538452608:12345-0@lo:501: 00000100:00100000:3.0:1788836131.774532:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538452608:12345-0@lo:501: Request processed in 430us (488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836131.774541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788836131.776286:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538451840:12345-0@lo:8: Request processed in 7820us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836131.776298:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788836131.776385:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836131.779323:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538452608:0@lo:501: 10000000:01000000:2.0:1788836131.779404:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788836131.779413:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836131.779423:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788836131.783370:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b255180 x1875730538451840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836131.783385:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836131.783394:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788836131.783404:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788836131.783411:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788836131.783415:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788836131.783787:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788836131.783796:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538451840:0@lo:8: 00000004:00080000:1.0:1788836131.783837:0:8089:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788836131.783946:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 184918602199ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788836131.887967:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788836131.888179:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1788836131.888202:0:8090:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788836131.888235:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538452864:0@lo:7: 00000100:00100000:2.0:1788836131.888306:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836131.888376:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517df3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836131.888396:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452864 00000100:00100000:2.0:1788836131.888402:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452864 00000100:00100000:2.0:1788836131.888454:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836131.888463:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8090:x1875730538452864:12345-0@lo:7: 00000100:00080000:3.0:1788836131.892086:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836131.892174:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538452736:0@lo:13: 00000100:00100000:0.0:1788836131.892249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.892313:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452736 00000100:00100000:0.0:1788836131.892321:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452736 00000100:00100000:0.0:1788836131.892392:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836131.892401:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875730538452736:12345-0@lo:13: 00002000:00000024:0.0:1788836131.892433:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788836131.892475:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875730538452736:12345-0@lo:13: Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836131.892482:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788836131.892578:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b257b80 x1875730538452736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836131.892598:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538452736:0@lo:13: 00002000:00080000:2.0:1788836131.895266:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788836131.895274:0:6681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788836131.895381:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8090:x1875730538452864:12345-0@lo:7: Request processed in 6916us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836131.895390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788836131.895871:0:8090:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b254e00 x1875730538452864/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836131.895886:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538452864:0@lo:7: 00000004:00080000:0.0:1788836131.895900:0:8090:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788836131.895935:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538452992:0@lo:5: 00000100:00100000:0.0:1788836131.895970:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.895992:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0451fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836131.896009:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538452992 00000100:00100000:0.0:1788836131.896014:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538452992 00000100:00100000:0.0:1788836131.896068:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836131.896077:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8090:x1875730538452992:12345-0@lo:5: 00002000:00080000:0.0:1788836131.896102:0:6683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788836131.896105:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788836131.896376:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8090:x1875730538452992:12345-0@lo:5: Request processed in 299us (404us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788836131.896382:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788836131.896412:0:8090:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454bb800 x1875730538452992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836131.896423:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538452992:0@lo:5: 00000004:00080000:0.0:1788836131.896431:0:8090:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788836131.896453:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538453120:0@lo:700: 00000100:00100000:0.0:1788836131.896477:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836131.896490:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0451fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836131.896661:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453120 00000100:00100000:3.0:1788836131.896666:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453120 00000100:00100000:3.0:1788836131.896703:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836131.896711:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8090:x1875730538453120:12345-0@lo:700: 00000100:00100000:3.0:1788836131.896738:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875730538453248:0@lo:700: 00000100:00100000:3.0:1788836131.896778:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836131.896795:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07a3e6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836131.896852:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453248 00000100:00100000:2.0:1788836131.896857:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453248 00000100:00100000:2.0:1788836131.896890:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836131.896897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875730538453248:12345-0@lo:700: 40000000:02000000:1.0:1788836131.944494:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788836131.951788:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875730538453248:12345-0@lo:700: Request processed in 54886us (55004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836131.951801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836131.951816:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd04674e300 x1875730538453248/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788836147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836131.951832:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875730538453248:0@lo:700: 40000000:02000000:3.0:1788836131.951859:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788836132.027504:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788836132.027531:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788836132.027798:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8090:x1875730538453120:12345-0@lo:700: Request processed in 131084us (131315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836132.027810:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836132.027981:0:8090:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454b8e00 x1875730538453120/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788836147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836132.027993:0:8090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788836132.028011:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538453120:0@lo:700: 00000004:02000040:0.0:1788836132.064646:0:8090:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788836132.067722:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538453376:0@lo:5: 00000100:00100000:0.0:1788836132.068226:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836132.068307:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0451fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836132.071923:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453376 00000100:00100000:3.0:1788836132.071938:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453376 00000100:00100000:1.0:1788836132.072374:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836132.072386:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8090:x1875730538453376:12345-0@lo:5: 00002000:00080000:1.0:1788836132.077807:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788836132.077827:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788836132.080541:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8090:x1875730538453376:12345-0@lo:5: Request processed in 8149us (12306us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788836132.080556:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788836132.080774:0:8090:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454b8e00 x1875730538453376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836148 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836132.080806:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8090:1875730538453376:0@lo:5: 00000004:00080000:2.0:1788836132.080819:0:8090:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788836132.628289:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788836133.524830:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788836133.651563:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836133.972301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836133.972487:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518507648 00000100:00100000:1.0:1788836133.972506:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518507648 00000100:00100000:1.0:1788836133.972539:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1788836133.972546:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875730518507648:12345-192.168.203.52@tcp:250: 00010000:00080000:1.0:1788836133.972572:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 46565d0b-6fff-423e-81f2-1747715bb465@192.168.203.52@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788836133.972603:0:5822:0:(genops.c:1385:class_connect()) connect: client 46565d0b-6fff-423e-81f2-1747715bb465, cookie 0xcb5b7bc40b9092b2 00000100:00080000:1.0:1788836133.972747:0:5822:0:(import.c:65:import_set_state_nolock()) ffff9bd07985e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836133.972807:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+5:2352:x1875730518507648:12345-192.168.203.52@tcp:250: Request processed in 260us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836133.972814:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:3.0:1788836133.982035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836133.982179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518507776 00000100:00100000:2.0:1788836133.982189:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518507776 00000100:00100000:2.0:1788836133.982242:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:2.0:1788836133.982253:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+5:5578:x1875730518507776:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788836133.982270:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836133.982288:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a5c9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836133.982316:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836133.982328:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836133.982337:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d3a00, rc 0) 00000100:00100000:2.0:1788836133.982413:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+6:5578:x1875730518507776:12345-192.168.203.52@tcp:101: Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836133.982419:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:0.0:1788836133.988955:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836133.989025:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518507904 00000100:00100000:3.0:1788836133.989035:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518507904 00000100:00100000:3.0:1788836133.989167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1788836133.989178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+6:5578:x1875730518507904:12345-192.168.203.52@tcp:501: 00000100:00100000:3.0:1788836133.989619:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+6:5578:x1875730518507904:12345-192.168.203.52@tcp:501: Request processed in 440us (672us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836133.989627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:0.0:1788836133.995134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836133.995210:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508032 00000100:00100000:1.0:1788836133.995220:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508032 00000100:00100000:1.0:1788836133.995314:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:1.0:1788836133.995326:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+6:5578:x1875730518508032:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1788836133.995383:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836133.995399:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a5d0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836133.995427:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836133.995441:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836133.995449:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377000, rc 0) 00000100:00100000:1.0:1788836133.995521:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+7:5578:x1875730518508032:12345-192.168.203.52@tcp:101: Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836133.995527:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1788836134.003882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836134.003914:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508160 00000100:00100000:3.0:1788836134.004369:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508160 00000100:00100000:3.0:1788836134.004414:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788836134.004426:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+7:5578:x1875730518508160:12345-192.168.203.52@tcp:501: 00000100:00100000:3.0:1788836134.005321:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+8:5578:x1875730518508160:12345-192.168.203.52@tcp:501: Request processed in 893us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836134.005330:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1788836134.007443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836134.012546:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508288 00000100:00100000:3.0:1788836134.012946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508288 00000100:00100000:2.0:1788836134.013227:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1788836134.013239:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+8:5578:x1875730518508288:12345-192.168.203.52@tcp:503: 00000100:00100000:2.0:1788836134.013704:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+8:5578:x1875730518508288:12345-192.168.203.52@tcp:503: Request processed in 465us (6268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.013713:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1788836134.019923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836134.020152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508416 00000100:00100000:2.0:1788836134.020163:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508416 00000100:00100000:2.0:1788836134.020219:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1788836134.020229:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+8:5597:x1875730518508416:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788836134.020670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+8:5597:x1875730518508416:12345-192.168.203.52@tcp:502: Request processed in 441us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.020678:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788836134.046804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836134.046911:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508544 00000100:00100000:2.0:1788836134.046922:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508544 00000100:00100000:2.0:1788836134.046978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1788836134.046989:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+8:5597:x1875730518508544:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788836134.047372:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+8:5597:x1875730518508544:12345-192.168.203.52@tcp:502: Request processed in 384us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.047381:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1788836134.052450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836134.054444:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508672 00000100:00100000:2.0:1788836134.054460:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508672 00000100:00100000:2.0:1788836134.054518:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1788836134.054528:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+8:5578:x1875730518508672:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788836134.054544:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836134.054561:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b9092c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a5fa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836134.054589:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b9092c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5fa expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836134.054600:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b9092c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5fa expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836134.054620:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2600, rc 0) 00000100:00100000:2.0:1788836134.054682:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:5578:x1875730518508672:12345-192.168.203.52@tcp:101: Request processed in 155us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.054689:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1788836134.060987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836134.062774:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508800 00000100:00100000:3.0:1788836134.062787:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508800 00000100:00100000:3.0:1788836134.062836:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788836134.062846:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+9:5578:x1875730518508800:12345-192.168.203.52@tcp:256: 20000000:01000000:3.0:1788836134.062871:0:5822:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788836134.062890:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788836134.062895:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788836134.062898:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788836134.062900:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788836134.066616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+9:5578:x1875730518508800:12345-192.168.203.52@tcp:256: Request processed in 3760us (5627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836134.066631:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788836134.072828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836134.072929:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518508928 00000100:00100000:1.0:1788836134.072938:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518508928 00000100:00100000:1.0:1788836134.072984:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1788836134.072993:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+9:5578:x1875730518508928:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1788836134.073009:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836134.073026:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a601 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836134.073051:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836134.073711:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836134.073720:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376e00, rc 0) 00000100:00100000:1.0:1788836134.073782:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5578:x1875730518508928:12345-192.168.203.52@tcp:101: Request processed in 789us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836134.073789:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1788836134.077021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836134.077139:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509056 00000100:00100000:3.0:1788836134.077149:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509056 00000100:00100000:3.0:1788836134.077199:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:3.0:1788836134.077209:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:5578:x1875730518509056:12345-192.168.203.52@tcp:501: 00000100:00100000:3.0:1788836134.077596:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:5578:x1875730518509056:12345-192.168.203.52@tcp:501: Request processed in 387us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836134.077603:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788836134.081749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836134.081946:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509184 00000100:00100000:1.0:1788836134.081958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509184 00000100:00100000:1.0:1788836134.082018:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788836134.082038:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5578:x1875730518509184:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1788836134.082625:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5578:x1875730518509184:12345-192.168.203.52@tcp:503: Request processed in 596us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836134.082634:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:0.0:1788836134.087259:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836134.087340:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509312 00000100:00100000:2.0:1788836134.087363:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509312 00000100:00100000:2.0:1788836134.087423:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1788836134.087434:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5602:x1875730518509312:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788836134.087709:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5602:x1875730518509312:12345-192.168.203.52@tcp:502: Request processed in 276us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.087717:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788836134.092655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836134.098159:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509440 00000100:00100000:1.0:1788836134.098175:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509440 00000100:00100000:1.0:1788836134.101508:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788836134.101525:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5602:x1875730518509440:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1788836134.101772:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5602:x1875730518509440:12345-192.168.203.52@tcp:502: Request processed in 251us (9124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836134.101781:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1788836134.111035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836134.111291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509568 00000100:00100000:3.0:1788836134.111310:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509568 00000100:00100000:3.0:1788836134.111401:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788836134.111423:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875730518509568:12345-192.168.203.52@tcp:38: 00010000:00080000:3.0:1788836134.111462:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1788836134.111526:0:5829:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b9092d5 00000004:00100000:3.0:1788836134.111564:0:5829:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788836134.111572:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788836134.144571:0:5829:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836134.144696:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518509568:12345-192.168.203.52@tcp:38: Request processed in 33273us (33669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836134.144708:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00010000:00010000:3.0:1788836134.672782:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836135.152825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836135.152883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836135.152982:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509824 00000100:00100000:0.0:1788836135.152982:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509696 00000100:00100000:2.0:1788836135.152992:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509824 00000100:00100000:0.0:1788836135.152992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509696 00000100:00100000:0.0:1788836135.153056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:3.0:1788836135.153062:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836135.153066:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:0:x1875730518509696:12345-192.168.203.52@tcp:41: 00000004:00000024:0.0:1788836135.153111:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788836135.153184:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:0:x1875730518509696:12345-192.168.203.52@tcp:41: Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836135.153192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836135.153211:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836135.153218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518509824:12345-192.168.203.52@tcp:41: 00000004:00000024:0.0:1788836135.153230:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788836135.153249:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518509824:12345-192.168.203.52@tcp:41: Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836135.153254:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788836135.155413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836135.159777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518509952 00000100:00100000:2.0:1788836135.159793:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518509952 00000100:00100000:2.0:1788836135.159868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836135.159877:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518509952:12345-192.168.203.52@tcp:40: 00000100:00100000:2.0:1788836135.159976:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518509952:12345-192.168.203.52@tcp:40: Request processed in 100us (4571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836135.160002:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788836135.162318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836135.162437:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510336 00000100:00100000:2.0:1788836135.162446:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510336 00000100:00100000:2.0:1788836135.162507:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836135.162517:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518510336:12345-192.168.203.52@tcp:33: 00000100:00100000:2.0:1788836135.163372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836135.163401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836135.163427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836135.163737:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510080 00000100:00100000:3.0:1788836135.163746:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510080 00000100:00100000:3.0:1788836135.163778:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510208 00000100:00100000:3.0:1788836135.163782:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510208 00000100:00100000:3.0:1788836135.163796:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836135.163801:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518510080:12345-192.168.203.52@tcp:8: 00010000:00080000:3.0:1788836135.163828:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1788836135.163869:0:6680:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b9092dc 00002000:00100000:3.0:1788836135.163881:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 539937c3-f568-41e1-b7b5-fe9413243b52/ffff9bcf448a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836135.163906:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836135.164254:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836135.164285:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836135.164372:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518510080:12345-192.168.203.52@tcp:8: Request processed in 568us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836135.164380:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836135.164400:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836135.164405:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518510208:12345-192.168.203.52@tcp:8: 00010000:00080000:3.0:1788836135.164421:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1788836135.164440:0:6680:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b9092e3 00002000:00100000:3.0:1788836135.164446:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 539937c3-f568-41e1-b7b5-fe9413243b52/ffff9bcf448a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836135.164460:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836135.165186:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836135.165210:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836135.165264:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518510208:12345-192.168.203.52@tcp:8: Request processed in 857us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836135.165272:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788836135.165332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510464 00000100:00100000:1.0:1788836135.165370:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510464 00000100:00100000:1.0:1788836135.165408:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1788836135.165424:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518510464:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788836135.165455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518510464:12345-192.168.203.52@tcp:400: Request processed in 35us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836135.165461:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000004:00080000:2.0:1788836135.184408:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21816us 00000004:00200000:1.0:1788836135.207822:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788836135.207948:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:5578:x1875730518510336:12345-192.168.203.52@tcp:33: Request processed in 45427us (45632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836135.207962:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836135.457618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836135.460557:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510592 00000100:00100000:0.0:1788836135.460572:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510592 00000100:00100000:0.0:1788836135.460835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836135.460847:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:5619:x1875730518510592:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1788836135.460868:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836135.460946:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b9092ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a62b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461021:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461035:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461050:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836135.461085:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836135.461089:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836135.461105:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461131:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b9092ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a62b expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461151:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a62b expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836135.461159:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836135.461162:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836135.461166:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031a00, rc 0) 00000100:00100000:0.0:1788836135.462034:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:5619:x1875730518510592:12345-192.168.203.52@tcp:101: Request processed in 1185us (4422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836135.462042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:2.0:1788836135.696612:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836136.721505:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836136.785176:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538453504:0@lo:13: 00000100:00100000:0.0:1788836136.785264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836136.786054:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453504 00000100:00100000:2.0:1788836136.786063:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453504 00000100:00100000:2.0:1788836136.786134:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836136.786146:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538453504:12345-0@lo:13: 00002000:00000024:2.0:1788836136.786169:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836136.786240:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538453504:12345-0@lo:13: Request processed in 96us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836136.786246:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788836136.786289:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b256300 x1875730538453504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836136.786310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538453504:0@lo:13: 00000100:00080000:0.0:1788836136.786442:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836136.786690:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538453888:0@lo:400: 00000100:00100000:3.0:1788836136.786731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836136.786752:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836136.786756:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538453760:0@lo:400: 00000100:00100000:3.0:1788836136.786775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836136.786834:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538453632:0@lo:400: 00000100:00100000:1.0:1788836136.786862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836136.786890:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538454144:0@lo:400: 00000100:00100000:1.0:1788836136.786910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836136.786934:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836136.786940:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538454016:0@lo:400: 00000100:00100000:1.0:1788836136.786962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836136.786988:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454144 00000100:00100000:1.0:1788836136.786993:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454144 00000100:00100000:1.0:1788836136.787027:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836136.787035:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538454144:12345-0@lo:400: 00000100:00100000:1.0:1788836136.787075:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538454144:12345-0@lo:400: Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836136.787082:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788836136.787096:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836136.787104:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453888 00000100:00100000:1.0:1788836136.787107:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453888 00000100:00100000:1.0:1788836136.787128:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453760 00000100:00100000:1.0:1788836136.787131:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453760 00000100:00100000:1.0:1788836136.787152:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454016 00000100:00100000:1.0:1788836136.787154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454016 00000100:00100000:1.0:1788836136.787168:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836136.787174:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538453888:12345-0@lo:400: 00000100:00100000:0.0:1788836136.787634:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788836136.787645:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788836136.787766:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836136.787775:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538453760:12345-0@lo:400: 00000100:00100000:0.0:1788836136.787822:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538453760:12345-0@lo:400: Request processed in 48us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836136.787827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836136.787841:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788836136.787848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836136.787853:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538454016:12345-0@lo:400: 00000100:00100000:0.0:1788836136.787881:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538454016:12345-0@lo:400: Request processed in 27us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836136.787886:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836136.788040:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538454016:0@lo:400: 00010000:00080000:0.0:1788836136.788054:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a351180 x1875730538454144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836136.788062:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788836136.788075:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538454144:0@lo:400: 00000100:00080000:0.0:1788836136.788105:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836136.788176:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538453888:12345-0@lo:400: Request processed in 1001us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836136.788182:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836136.788471:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538453632 00000100:00100000:3.0:1788836136.788534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538453632 00000100:00100000:3.0:1788836136.788575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788836136.788581:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538453632:12345-0@lo:400: 00000100:00100000:3.0:1788836136.789772:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538453632:12345-0@lo:400: Request processed in 1186us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836136.789782:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788836136.789854:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538453760:0@lo:400: 00000100:00100000:3.0:1788836136.789867:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538453888:0@lo:400: 00000100:00100000:0.0:1788836136.790028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538453632:0@lo:400: 00000100:00100000:0.0:1788836137.296645:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538454272:0@lo:13: 00000100:00100000:0.0:1788836137.296730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836137.296889:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454272 00000100:00100000:1.0:1788836137.296898:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454272 00000100:00100000:1.0:1788836137.296951:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836137.296960:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538454272:12345-0@lo:13: 00002000:00000024:1.0:1788836137.296995:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836137.300857:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538454272:12345-0@lo:13: Request processed in 3887us (4115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836137.300870:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788836137.301174:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b256300 x1875730538454272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836137.301198:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538454272:0@lo:13: 00000100:00100000:1.0:1788836137.588445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836137.588682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510720 00000100:00100000:0.0:1788836137.588691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510720 00000100:00100000:0.0:1788836137.588785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836137.588796:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:5671:x1875730518510720:12345-192.168.203.52@tcp:41: 00000004:00000024:0.0:1788836137.588838:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788836137.588975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:5671:x1875730518510720:12345-192.168.203.52@tcp:41: Request processed in 181us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836137.588983:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1788836137.589292:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836137.592922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836137.593074:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510848 00000100:00100000:3.0:1788836137.593083:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510848 00000100:00100000:3.0:1788836137.593151:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836137.593161:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:539937c3-f568-41e1-b7b5-fe9413243b52+6:5671:x1875730518510848:12345-192.168.203.52@tcp:13: 00002000:00000024:3.0:1788836137.593200:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836137.593282:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:539937c3-f568-41e1-b7b5-fe9413243b52+6:5671:x1875730518510848:12345-192.168.203.52@tcp:13: Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836137.593305:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00080000:2.0:1788836137.594849:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836137.596027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836137.596122:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518510976 00000100:00100000:3.0:1788836137.596131:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518510976 00000100:00080000:2.0:1788836137.596260:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836137.597363:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836137.597382:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:539937c3-f568-41e1-b7b5-fe9413243b52+6:5671:x1875730518510976:12345-192.168.203.52@tcp:13: 00002000:00000024:3.0:1788836137.597410:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836137.597487:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:539937c3-f568-41e1-b7b5-fe9413243b52+6:5671:x1875730518510976:12345-192.168.203.52@tcp:13: Request processed in 112us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836137.597495:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:3.0:1788836137.744820:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836138.768820:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836139.424432:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000001:00100000:0.0:1788836139.430182:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000001:00100000:3.0:1788836139.439125:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00010000:00010000:2.0:1788836139.795012:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788836139.933030:0:8282:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788836140.229331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836140.229418:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836140.229439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836140.229493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836140.229524:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511360 00000100:00100000:0.0:1788836140.229533:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511360 00000100:00100000:0.0:1788836140.229587:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511488 00000100:00100000:0.0:1788836140.229591:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511488 00000100:00100000:0.0:1788836140.229609:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836140.229618:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518511360:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1788836140.229707:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518511360:12345-192.168.203.52@tcp:400: Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836140.229716:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836140.229732:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836140.229738:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518511488:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1788836140.229778:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518511488:12345-192.168.203.52@tcp:400: Request processed in 40us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836140.229785:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836140.229801:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511232 00000100:00080000:0.0:1788836140.229805:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836140.229808:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511232 00000100:00080000:0.0:1788836140.229811:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836140.229855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788836140.229865:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518511232:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788836140.229898:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518511232:12345-192.168.203.52@tcp:400: Request processed in 36us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836140.229904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836140.230124:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511104 00000100:00100000:3.0:1788836140.230130:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511104 00000100:00100000:3.0:1788836140.230167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1788836140.230175:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518511104:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788836140.230203:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518511104:12345-192.168.203.52@tcp:400: Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836140.230209:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00080000:0.0:1788836140.230360:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788836140.820333:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836141.849053:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836141.904701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538454528:0@lo:400: 00000100:00100000:0.0:1788836141.904783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836141.904835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538455040:0@lo:400: 00000100:00100000:0.0:1788836141.904865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836141.904897:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836141.904914:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538454656:0@lo:400: 00000100:00100000:0.0:1788836141.904941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836141.904974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454528 00000100:00100000:0.0:1788836141.904991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454528 00000100:00100000:0.0:1788836141.905043:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454656 00000100:00100000:0.0:1788836141.905046:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454656 00000100:00100000:0.0:1788836141.905076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836141.905085:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538454528:12345-0@lo:400: 00000100:00100000:0.0:1788836141.905146:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538454528:12345-0@lo:400: Request processed in 62us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836141.905154:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836141.905172:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836141.905178:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538454656:12345-0@lo:400: 00000100:00100000:0.0:1788836141.905207:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538454656:12345-0@lo:400: Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836141.905212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836141.905239:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455040 00000100:00100000:0.0:1788836141.905242:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455040 00000100:00100000:0.0:1788836141.905266:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836141.905273:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538455040:12345-0@lo:400: 00000100:00100000:0.0:1788836141.905307:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538455040:12345-0@lo:400: Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836141.905314:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788836141.905334:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836141.905339:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836141.905415:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538454656:0@lo:400: 00000100:00100000:0.0:1788836141.905426:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538454528:0@lo:400: 00010000:00080000:0.0:1788836141.905439:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3c000 x1875730538455040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836141.905449:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538455040:0@lo:400: 00000100:00100000:2.0:1788836141.905697:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538454784:0@lo:400: 00000100:00100000:2.0:1788836141.905732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836141.905759:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836141.905766:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538454400:0@lo:400: 00000100:00100000:2.0:1788836141.905795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836141.905820:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538454912:0@lo:400: 00000100:00100000:2.0:1788836141.905845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836141.905868:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454784 00000100:00100000:2.0:1788836141.905872:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454784 00000100:00100000:2.0:1788836141.905901:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836141.905907:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538454784:12345-0@lo:400: 00000100:00100000:2.0:1788836141.905943:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538454784:12345-0@lo:400: Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836141.905949:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836141.905966:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454400 00000100:00100000:2.0:1788836141.905969:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454400 00000100:00100000:2.0:1788836141.906015:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788836141.906023:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538454400:12345-0@lo:400: 00000100:00100000:2.0:1788836141.906054:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538454400:12345-0@lo:400: Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836141.906061:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788836141.906097:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538454400:0@lo:400: 00000100:00100000:3.0:1788836141.906189:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538454912 00000100:00100000:3.0:1788836141.906193:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538454912 00000100:00100000:3.0:1788836141.906224:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788836141.906231:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538454912:12345-0@lo:400: 00010000:00080000:2.0:1788836141.906273:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3df80 x1875730538454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836141.906284:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538454784:0@lo:400: 00000100:00100000:0.0:1788836141.906572:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538455168:0@lo:13: 00000100:00100000:3.0:1788836141.906845:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538454912:12345-0@lo:400: Request processed in 613us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836141.906857:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836141.908099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836141.908380:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455168 00000100:00100000:0.0:1788836141.908387:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455168 00000100:00100000:0.0:1788836141.908429:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836141.908437:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538455168:12345-0@lo:13: 00002000:00000024:0.0:1788836141.908470:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836141.908512:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538455168:12345-0@lo:13: Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836141.908518:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788836141.908540:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836141.908544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836141.908583:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3c000 x1875730538455168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836141.908603:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538455168:0@lo:13: 00000100:00100000:2.0:1788836141.909207:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538454912:0@lo:400: 00000100:00100000:2.0:1788836142.418951:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836142.418977:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538455296:0@lo:13: 00000100:00100000:2.0:1788836142.419046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836142.420973:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455296 00000100:00100000:0.0:1788836142.420985:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455296 00000100:00100000:1.0:1788836142.421143:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836142.421156:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538455296:12345-0@lo:13: 00002000:00000024:1.0:1788836142.421196:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836142.421314:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538455296:12345-0@lo:13: Request processed in 161us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836142.421321:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788836142.421426:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b255880 x1875730538455296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836142.421448:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538455296:0@lo:13: 00010000:00010000:2.0:1788836142.865075:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836143.020392:0:8429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe709677a0 20000000:00000080:2.0:1788836143.020408:0:8429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd079de1400 uarg=0000000000000000 20000000:01000000:2.0:1788836143.020504:0:8429:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788836143.020506:0:8429:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788836143.020508:0:8429:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788836143.020513:0:8429:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788836143.020518:0:8429:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788836143.020532:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788836143.020535:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788836143.020769:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788836143.020772:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788836143.022416:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788836143.023524:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788836143.023570:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788836143.023598:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788836143.023613:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788836143.023615:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788836143.027789:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788836143.028979:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788836143.029063:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788836143.029104:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788836143.029119:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788836143.029122:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788836143.035004:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788836143.035651:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788836143.035719:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788836143.035782:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788836143.035798:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788836143.035801:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788836143.036691:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788836143.037173:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788836143.038588:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788836143.038670:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1788836143.038706:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788836143.038726:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038744:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038753:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038760:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038768:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038775:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038783:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038806:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038816:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038824:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038858:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038900:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.038918:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 9 pid: 5822 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.038933:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a352680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455424:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836143.039046:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039056:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.039065:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455552:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836143.039097:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039117:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 18 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.039127:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455680:0@lo:104: 00000100:00100000:3.0:1788836143.039165:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836143.039199:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039208:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 18 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.039217:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455808:0@lo:104: 00000100:00100000:3.0:1788836143.039239:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836143.039258:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039267:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 18 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.039275:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455936:0@lo:104: 00010000:00010000:3.0:1788836143.039298:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039306:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 18 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.039314:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456064:0@lo:104: 00010000:00010000:3.0:1788836143.039337:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.039376:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 18 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836143.039648:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788836143.039669:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836143.039695:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836143.039704:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455680 00000100:00100000:0.0:1788836143.039711:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455680 00000100:00100000:0.0:1788836143.039744:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455808 00000100:00100000:0.0:1788836143.039747:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455808 00000100:00100000:0.0:1788836143.039755:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538455936 00000100:00100000:0.0:1788836143.039757:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538455936 00000100:00100000:0.0:1788836143.039767:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456064 00000100:00100000:0.0:1788836143.039769:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456064 00000100:00100000:0.0:1788836143.039781:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836143.039789:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:8429:x1875730538455680:12345-0@lo:104: 00010000:00010000:0.0:1788836143.039801:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.039843:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836143.039848:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+6:8429:x1875730538455680:12345-0@lo:104: Request processed in 61us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.039855:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836143.039884:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836143.039897:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8429:x1875730538455808:12345-0@lo:104: 00010000:00010000:0.0:1788836143.039905:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.039940:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836143.039946:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8429:x1875730538455808:12345-0@lo:104: Request processed in 50us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.039951:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836143.039988:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836143.039997:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8429:x1875730538455936:12345-0@lo:104: 00010000:00010000:0.0:1788836143.040004:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040031:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788836143.040036:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8429:x1875730538455936:12345-0@lo:104: Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.040042:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836143.040053:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836143.040057:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8429:x1875730538456064:12345-0@lo:104: 00010000:00010000:0.0:1788836143.040064:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040085:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788836143.040089:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8429:x1875730538456064:12345-0@lo:104: Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.040094:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788836143.040108:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788836143.040119:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040126:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836143.040129:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040138:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836143.040145:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836143.040150:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836143.040176:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040182:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836143.040198:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040204:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b9092a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9092ab expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040215:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788836143.040218:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040223:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836143.040225:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040241:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836143.040247:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836143.040251:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836143.040264:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040269:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836143.040282:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040288:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d800/0xcb5b7bc40b90927a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909281 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040298:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836143.040301:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040307:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836143.040310:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.040317:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836143.040324:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836143.040335:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836143.040377:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040732:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836143.040738:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040746:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836143.040749:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040756:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836143.040763:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836143.040769:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836143.040785:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040791:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836143.040797:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040805:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c400/0xcb5b7bc40b909250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909257 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.040816:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836143.040818:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836143.040820:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836143.040831:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836143.041437:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836143.041454:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538456320:0@lo:103: 00000100:00100000:1.0:1788836143.041497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836143.041697:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836143.041722:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.041731:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040031800/0xcb5b7bc40b90925e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909265 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.041742:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836143.041744:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836143.041746:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836143.041757:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538456448:0@lo:103: 00000100:00100000:0.0:1788836143.041785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836143.041803:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836143.041809:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538456704:0@lo:103: 00000100:00100000:0.0:1788836143.041828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836143.041848:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836143.041856:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538456576:0@lo:103: 00000100:00100000:2.0:1788836143.041991:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456320 00000100:00100000:2.0:1788836143.041998:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456320 00010000:00010000:2.0:1788836143.042027:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 19 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.042052:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456448 00000100:00100000:2.0:1788836143.042055:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456448 00010000:00010000:2.0:1788836143.042065:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 20 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.042076:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456704 00000100:00100000:2.0:1788836143.042078:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456704 00010000:00010000:2.0:1788836143.042088:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 21 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.042101:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836143.042109:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538456320:12345-0@lo:103: 00010000:00010000:2.0:1788836143.042122:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.042128:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 21 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042138:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 21 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042157:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.042186:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538456320:12345-0@lo:103: Request processed in 78us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.042194:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836143.042210:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836143.042216:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+20:3304:x1875730538456448:12345-0@lo:103: 00010000:00010000:2.0:1788836143.042247:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.042252:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 20 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042262:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 20 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042272:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.042299:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+20:3304:x1875730538456448:12345-0@lo:103: Request processed in 83us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.042306:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836143.042319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836143.042326:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538456704:12345-0@lo:103: 00010000:00010000:2.0:1788836143.042334:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.042338:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 19 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042372:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 19 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.042382:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.042525:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538456704:12345-0@lo:103: Request processed in 199us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.042532:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836143.042576:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538456704:0@lo:103: 00000100:00100000:2.0:1788836143.042584:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538456448:0@lo:103: 00000100:00100000:0.0:1788836143.042758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836143.042851:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538456320:0@lo:103: 00000100:00100000:3.0:1788836143.043066:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a353800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456192:0@lo:104: 00000100:00100000:3.0:1788836143.043098:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836143.043139:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.043151:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 18 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.043163:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456832:0@lo:104: 00000100:00100000:3.0:1788836143.043183:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836143.043216:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.043237:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 18 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.043246:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a352a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456960:0@lo:104: 00000100:00100000:3.0:1788836143.043266:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836143.043276:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd051523b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788836143.043290:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b9092ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9092a4 expref: 18 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.043302:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455680:0@lo:104: 00010000:00010000:3.0:1788836143.043312:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90927a expref: 17 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.043335:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455808:0@lo:104: 00000100:00100000:3.0:1788836143.043369:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455936:0@lo:104: 00010000:00010000:3.0:1788836143.043378:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d600/0xcb5b7bc40b909257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909250 expref: 16 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.043398:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456064:0@lo:104: 00000100:00100000:2.0:1788836143.043477:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456576 00000100:00100000:2.0:1788836143.043483:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456576 00010000:00010000:2.0:1788836143.043506:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.043538:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836143.043545:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3303:x1875730538456576:12345-0@lo:103: 00010000:00010000:2.0:1788836143.043554:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.043558:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.043567:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.043579:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b909265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90925e expref: 16 pid: 5823 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.043589:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.043622:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3303:x1875730538456576:12345-0@lo:103: Request processed in 77us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.043628:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836143.043653:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538456576:0@lo:103: 00000100:00100000:1.0:1788836143.043973:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456192 00000100:00100000:1.0:1788836143.043978:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456192 00000100:00100000:1.0:1788836143.043999:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456832 00000100:00100000:1.0:1788836143.044002:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456832 00000100:00100000:1.0:1788836143.044011:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538456960 00000100:00100000:1.0:1788836143.044014:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538456960 00000100:00100000:1.0:1788836143.044025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836143.044032:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8429:x1875730538456192:12345-0@lo:104: 00010000:00010000:1.0:1788836143.044048:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836143.044101:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836143.044107:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8429:x1875730538456192:12345-0@lo:104: Request processed in 76us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836143.044114:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836143.044127:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836143.044134:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8429:x1875730538456832:12345-0@lo:104: 00010000:00010000:1.0:1788836143.044142:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836143.044171:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836143.044176:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8429:x1875730538456832:12345-0@lo:104: Request processed in 44us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836143.044190:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836143.044203:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836143.044210:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8429:x1875730538456960:12345-0@lo:104: 00010000:00010000:1.0:1788836143.044218:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044463:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836143.044469:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044477:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836143.044481:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044490:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836143.044504:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836143.044510:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836143.044538:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044546:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836143.044560:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044568:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d400/0xcb5b7bc40b909242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909249 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044580:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836143.044583:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044588:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836143.044590:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044596:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836143.044602:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836143.044607:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788836143.044637:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044644:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836143.044658:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044663:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2a00/0xcb5b7bc40b909218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90921f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044672:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836143.044674:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836143.044675:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836143.044698:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538457088:0@lo:103: 00000100:00100000:2.0:1788836143.044733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836143.044775:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457088 00000100:00100000:2.0:1788836143.044780:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457088 00010000:00010000:2.0:1788836143.044799:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 15 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.044819:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836143.044825:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3303:x1875730538457088:12345-0@lo:103: 00010000:00010000:2.0:1788836143.044834:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.044838:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 15 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044846:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 15 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.044859:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.044893:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3303:x1875730538457088:12345-0@lo:103: Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.044900:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836143.044923:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538457216:0@lo:103: 00000100:00100000:2.0:1788836143.044947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836143.044970:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836143.044988:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538457088:0@lo:103: 00000100:00100000:2.0:1788836143.045005:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457216 00000100:00100000:2.0:1788836143.045009:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457216 00010000:00010000:2.0:1788836143.045021:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 15 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.045039:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836143.045045:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3304:x1875730538457216:12345-0@lo:103: 00010000:00010000:2.0:1788836143.045052:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836143.045056:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 15 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.045065:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 15 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.045075:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836143.045101:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3304:x1875730538457216:12345-0@lo:103: Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836143.045108:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836143.045129:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538457216:0@lo:103: 00010000:00010000:2.0:1788836143.045158:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376600/0xcb5b7bc40b909249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909242 expref: 14 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.045180:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a353800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456192:0@lo:104: 00010000:00010000:2.0:1788836143.045192:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030c00/0xcb5b7bc40b90921f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909218 expref: 13 pid: 5824 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.045200:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456832:0@lo:104: 00010000:00010000:1.0:1788836143.046845:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836143.046855:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8429:x1875730538456960:12345-0@lo:104: Request processed in 2643us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836143.046865:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788836143.047256:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836143.047265:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047275:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836143.047279:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047302:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836143.047310:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836143.047315:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836143.047378:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047396:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836143.047413:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047421:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060376000/0xcb5b7bc40b9091ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9091f5 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047439:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836143.047441:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836143.047443:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836143.047455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538457344:0@lo:103: 00000100:00100000:0.0:1788836143.047499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836143.047537:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457344 00000100:00100000:0.0:1788836143.047544:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457344 00010000:00010000:0.0:1788836143.047570:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 13 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836143.047598:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836143.047606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047942050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3305:x1875730538457344:12345-0@lo:103: 00010000:00010000:0.0:1788836143.047624:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836143.047629:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 13 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047638:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 13 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.047654:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836143.047697:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047942050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:3305:x1875730538457344:12345-0@lo:103: Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.047704:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836143.047761:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538457344:0@lo:103: 00010000:00010000:2.0:1788836143.048140:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b9091f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9091ee expref: 12 pid: 5822 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.048152:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a352a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538456960:0@lo:104: 00000100:00100000:1.0:1788836143.048327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836143.048453:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511616 00000100:00100000:3.0:1788836143.048458:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511616 00010000:00010000:3.0:1788836143.048480:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 10 pid: 5822 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836143.048501:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836143.048508:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518511616:12345-192.168.203.52@tcp:103: 00010000:00010000:3.0:1788836143.048518:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836143.048523:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 10 pid: 5822 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.048533:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 10 pid: 5822 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836143.048546:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836143.048582:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+10:2354:x1875730518511616:12345-192.168.203.52@tcp:103: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836143.048589:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:2.0:1788836143.048663:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b9092c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5d0 expref: 9 pid: 5822 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836143.048675:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a352680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455424:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836143.056535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836143.057896:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511744 00000100:00100000:0.0:1788836143.057908:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511744 00010000:00010000:0.0:1788836143.057951:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836143.057996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788836143.058006:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+9:2353:x1875730518511744:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1788836143.058020:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836143.058025:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058039:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 9 pid: 5824 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058059:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058085:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058102:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058110:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058117:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058125:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058131:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836143.058136:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058145:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058154:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058164:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836143.058216:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+9:2353:x1875730518511744:12345-192.168.203.52@tcp:103: Request processed in 210us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836143.058224:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00010000:00010000:0.0:1788836143.058286:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d3a00/0xcb5b7bc40b9092b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5c9 expref: 8 pid: 5824 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836143.058308:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1875730538455552:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836143.058368:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058378:0:8429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058395:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836143.058402:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b9092f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836143.889536:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788836144.529047:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788836144.529056:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd079eb5000 from 39 10000000:01000000:3.0:1788836144.529061:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788836144.529114:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.529125:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.529136:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836144.529156:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457472:0@lo:101: 00000100:00100000:3.0:1788836144.529220:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.529316:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457472 00000100:00100000:2.0:1788836144.529321:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457472 00000100:00100000:2.0:1788836144.529375:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788836144.529382:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+12:5826:x1875730538457472:12345-0@lo:101: 00010000:00010000:2.0:1788836144.529393:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836144.529403:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b909306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9092ff expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.529420:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b909306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9092ff expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.529436:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b909306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9092ff expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.529449:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2a00, rc 0) 00000100:00100000:2.0:1788836144.529481:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538457472:12345-0@lo:101: Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.529485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788836144.530206:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836144.530233:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457472:0@lo:101: 00010000:00010000:3.0:1788836144.530250:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.530260:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836144.530315:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457600:0@lo:501: 00000100:00100000:3.0:1788836144.530366:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.530451:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457600 00000100:00100000:1.0:1788836144.530456:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457600 00000100:00100000:1.0:1788836144.530498:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788836144.530505:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538457600:12345-0@lo:501: 00000100:00100000:3.0:1788836144.530736:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.530793:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538457600:12345-0@lo:501: Request processed in 287us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.530801:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788836144.531129:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457600:0@lo:501: 00000100:00100000:3.0:1788836144.531160:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457728:0@lo:503: 00000100:00100000:3.0:1788836144.531204:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836144.531260:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.531295:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457728 00000100:00100000:2.0:1788836144.531300:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457728 00000100:00100000:2.0:1788836144.531336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788836144.531371:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538457728:12345-0@lo:503: 00000100:00100000:2.0:1788836144.531617:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538457728:12345-0@lo:503: Request processed in 265us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.531624:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788836144.532115:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538457728:0@lo:503: 00000100:00100000:1.0:1788836144.533135:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8447:1875730538457856:0@lo:502: 00000100:00100000:1.0:1788836144.533196:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.533238:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.533324:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457856 00000100:00100000:2.0:1788836144.533330:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457856 00000100:00100000:2.0:1788836144.533397:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788836144.533405:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:8447:x1875730538457856:12345-0@lo:502: 00000100:00100000:2.0:1788836144.533631:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:8447:x1875730538457856:12345-0@lo:502: Request processed in 226us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.533638:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788836144.533656:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8447:1875730538457856:0@lo:502: 00000100:00100000:1.0:1788836144.533702:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8447:1875730538457984:0@lo:502: 00000100:00100000:1.0:1788836144.533734:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.533762:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.533785:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538457984 00000100:00100000:0.0:1788836144.533798:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538457984 00000100:00100000:0.0:1788836144.533834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788836144.533842:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:8447:x1875730538457984:12345-0@lo:502: 00000100:00100000:0.0:1788836144.534011:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:8447:x1875730538457984:12345-0@lo:502: Request processed in 169us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.534017:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788836144.534050:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8447:1875730538457984:0@lo:502: 00000040:00080000:3.0:1788836144.534076:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788836144.534704:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788836144.534723:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836144.535044:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.535056:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836144.535066:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788836144.535069:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788836144.535071:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836144.535099:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.535106:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.535115:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836144.535131:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458112:0@lo:101: 00000100:00100000:1.0:1788836144.535167:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.535245:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.535311:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458112 00000100:00100000:2.0:1788836144.535317:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458112 00000100:00100000:2.0:1788836144.535417:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788836144.535437:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+13:5826:x1875730538458112:12345-0@lo:101: 00010000:00010000:2.0:1788836144.535447:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836144.535465:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd0413d2400/0xcb5b7bc40b909314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90930d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.535499:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd0413d2400/0xcb5b7bc40b909314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90930d expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.535510:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd0413d2400/0xcb5b7bc40b909314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90930d expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.535519:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0413d2400, rc 0) 00000100:00100000:2.0:1788836144.535550:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458112:12345-0@lo:101: Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.535556:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788836144.535622:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458112:0@lo:101: 00010000:00010000:1.0:1788836144.535634:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.535643:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836144.535707:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458240:0@lo:501: 00000100:00100000:1.0:1788836144.535730:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.535995:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.537084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458240 00000100:00100000:0.0:1788836144.537093:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458240 00000100:00100000:0.0:1788836144.537133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788836144.537141:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458240:12345-0@lo:501: 00000100:00100000:0.0:1788836144.537434:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458240:12345-0@lo:501: Request processed in 293us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.537441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788836144.538283:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458240:0@lo:501: 00000100:00100000:1.0:1788836144.538330:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458368:0@lo:503: 00000100:00100000:1.0:1788836144.538412:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.538454:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.538566:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458368 00000100:00100000:0.0:1788836144.538572:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458368 00000100:00100000:0.0:1788836144.538619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788836144.538627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458368:12345-0@lo:503: 00000100:00100000:0.0:1788836144.539221:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458368:12345-0@lo:503: Request processed in 593us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.539230:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788836144.539392:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458368:0@lo:503: 00000100:00100000:1.0:1788836144.540045:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8448:1875730538458496:0@lo:502: 00000100:00100000:1.0:1788836144.540091:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.540127:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.540178:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458496 00000100:00100000:2.0:1788836144.540184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458496 00000100:00100000:2.0:1788836144.540222:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788836144.540229:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8448:x1875730538458496:12345-0@lo:502: 00000100:00100000:2.0:1788836144.540421:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8448:x1875730538458496:12345-0@lo:502: Request processed in 191us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.540436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788836144.540854:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8448:1875730538458496:0@lo:502: 00000020:01000000:0.0:1788836144.540881:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836144.540890:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836144.540892:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788836144.540899:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788836144.540937:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8448:1875730538458624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836144.540973:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836144.541014:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.541069:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458624 00000100:00100000:1.0:1788836144.541074:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458624 00000100:00100000:1.0:1788836144.541110:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788836144.541117:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8448:x1875730538458624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.541267:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:8448:x1875730538458624:12345-0@lo:502:llog_process_th.0 Request processed in 149us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.541275:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788836144.541591:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8448:1875730538458624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836144.541622:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836144.541627:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836144.541629:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788836144.541633:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788836144.541884:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788836144.541903:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788836144.541912:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.541933:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836144.541943:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788836144.541945:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd078fee000 from 39 10000000:01000000:2.0:1788836144.541948:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836144.541990:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.541998:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.542007:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.542023:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.542057:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.542088:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.543089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458752 00000100:00100000:1.0:1788836144.543099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458752 00000100:00100000:1.0:1788836144.543150:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788836144.543160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:5826:x1875730538458752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836144.543173:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836144.543189:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377a00/0xcb5b7bc40b909322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90931b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.543226:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377a00/0xcb5b7bc40b909322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90931b expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.543237:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377a00/0xcb5b7bc40b909322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90931b expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.543245:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377a00, rc 0) 00000100:00100000:1.0:1788836144.543306:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538458752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.543313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788836144.543729:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836144.543744:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.543754:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.543826:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.543859:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.543899:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.544552:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538458880 00000100:00100000:0.0:1788836144.544558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538458880 00000100:00100000:0.0:1788836144.544595:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836144.544603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538458880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.544902:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538458880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.544910:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788836144.544974:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538458880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.545251:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.545289:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836144.545305:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.545316:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459008 00000100:00100000:0.0:1788836144.545320:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459008 00000100:00100000:0.0:1788836144.545357:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836144.545364:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538459008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.545511:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538459008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.545519:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788836144.545555:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.545751:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8449:1875730538459136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836144.545783:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836144.548813:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e746c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.549303:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459136 00000100:00100000:1.0:1788836144.549312:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459136 00000100:00100000:1.0:1788836144.549384:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788836144.549394:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8449:x1875730538459136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.549861:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8449:x1875730538459136:12345-0@lo:502:llog_process_th.0 Request processed in 467us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.549870:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788836144.550156:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8449:1875730538459136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836144.550220:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8449:1875730538459264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836144.550262:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836144.550285:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.550335:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459264 00000100:00100000:1.0:1788836144.550367:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459264 00000100:00100000:1.0:1788836144.550398:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788836144.550405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8449:x1875730538459264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.551239:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:8449:x1875730538459264:12345-0@lo:502:llog_process_th.0 Request processed in 832us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.551250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788836144.551566:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8449:1875730538459264:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788836144.551597:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788836144.552525:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788836144.552549:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836144.552560:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.552573:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836144.552598:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788836144.552602:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788836144.552751:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836144.552785:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.552890:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.552901:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.553082:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.553132:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.553211:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.558696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459392 00000100:00100000:0.0:1788836144.558713:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459392 00000100:00100000:0.0:1788836144.558852:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788836144.558863:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:5826:x1875730538459392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836144.558881:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836144.558899:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031800/0xcb5b7bc40b909330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909329 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.558962:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031800/0xcb5b7bc40b909330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909329 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.558973:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031800/0xcb5b7bc40b909330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909329 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.559884:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031800, rc 0) 00000100:00100000:0.0:1788836144.560085:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538459392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1117us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.560093:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788836144.560194:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836144.560223:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.560233:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836144.560296:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.560327:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.562802:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.564228:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459520 00000100:00100000:2.0:1788836144.564241:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459520 00000100:00100000:2.0:1788836144.564293:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836144.564303:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538459520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.564831:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538459520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 528us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.564840:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788836144.565200:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.565253:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.565300:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.565339:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.565520:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459648 00000100:00100000:2.0:1788836144.565525:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459648 00000100:00100000:2.0:1788836144.565550:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788836144.565557:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538459648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.565734:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538459648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.565747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788836144.565779:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538459648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.566603:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8450:1875730538459776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.566666:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.566712:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0431783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.566828:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459776 00000100:00100000:2.0:1788836144.566834:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459776 00000100:00100000:2.0:1788836144.566938:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788836144.566948:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8450:x1875730538459776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.567133:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8450:x1875730538459776:12345-0@lo:502:llog_process_th.0 Request processed in 186us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.567142:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788836144.567159:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8450:1875730538459776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836144.567198:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836144.567206:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836144.567208:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836144.567213:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788836144.567231:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8450:1875730538459904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.567263:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836144.567283:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0431783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.567711:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538459904 00000100:00100000:2.0:1788836144.567717:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538459904 00000100:00100000:2.0:1788836144.567739:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788836144.567745:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8450:x1875730538459904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.568029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:8450:x1875730538459904:12345-0@lo:502:llog_process_th.0 Request processed in 282us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.568035:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788836144.568399:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8450:1875730538459904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836144.568436:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836144.568442:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836144.568444:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836144.568448:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788836144.569065:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788836144.569086:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788836144.569095:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.569105:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836144.569115:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788836144.569118:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd0497a5800 from 39 10000000:01000000:2.0:1788836144.569120:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836144.569149:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.569179:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.569189:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.569209:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.569252:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.569291:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.569294:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460032 00000100:00100000:0.0:1788836144.569299:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460032 00000100:00100000:0.0:1788836144.569407:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788836144.569416:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538460032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836144.569436:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836144.569451:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031400/0xcb5b7bc40b90933e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909337 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.569480:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031400/0xcb5b7bc40b90933e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909337 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.569490:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031400/0xcb5b7bc40b90933e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909337 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.569498:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031400, rc 0) 00000100:00100000:0.0:1788836144.569532:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.569538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788836144.569578:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836144.569590:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836144.569598:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836144.569774:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.569868:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836144.569884:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.569896:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460160 00000100:00100000:0.0:1788836144.569899:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460160 00000100:00100000:0.0:1788836144.570100:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788836144.570109:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.570727:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 618us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.570735:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788836144.570854:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.570891:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.571053:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.571086:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.571139:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460288 00000100:00100000:1.0:1788836144.571145:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460288 00000100:00100000:1.0:1788836144.571219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788836144.571227:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.571410:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.571417:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788836144.571758:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.572500:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8451:1875730538460416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.572552:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.572581:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.572890:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460416 00000100:00100000:0.0:1788836144.572897:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460416 00000100:00100000:0.0:1788836144.573066:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788836144.573075:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8451:x1875730538460416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836144.573311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8451:x1875730538460416:12345-0@lo:502:llog_process_th.0 Request processed in 237us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.573318:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788836144.573749:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8451:1875730538460416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836144.573818:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8451:1875730538460544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836144.573860:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836144.573898:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836144.574136:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460544 00000100:00100000:2.0:1788836144.574142:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460544 00000100:00100000:2.0:1788836144.574175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836144.574181:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8451:x1875730538460544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.574382:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8451:x1875730538460544:12345-0@lo:502:llog_process_th.0 Request processed in 201us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836144.574389:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836144.574444:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8451:1875730538460544:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788836144.574467:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788836144.574924:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788836144.574946:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836144.574956:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.574967:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836144.575101:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788836144.575104:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788836144.575107:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836144.575135:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.575143:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.575152:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836144.575179:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836144.575228:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836144.575261:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.576041:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460672 00000100:00100000:1.0:1788836144.576050:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460672 00000100:00100000:1.0:1788836144.576095:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788836144.576103:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538460672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836144.576116:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836144.576132:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377800/0xcb5b7bc40b90934c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909345 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.576159:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377800/0xcb5b7bc40b90934c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909345 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.576169:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377800/0xcb5b7bc40b90934c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909345 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.576177:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377800, rc 0) 00000100:00100000:1.0:1788836144.577486:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538460672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1376us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.577509:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788836144.581374:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836144.581402:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.581415:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.581685:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.581751:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.581780:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836144.582193:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460800 00000100:00100000:3.0:1788836144.582201:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460800 00000100:00100000:3.0:1788836144.582263:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788836144.582272:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538460800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836144.583226:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538460800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 952us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836144.583237:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836144.583553:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.583596:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.583647:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.583680:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.583833:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538460928 00000100:00100000:0.0:1788836144.583839:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538460928 00000100:00100000:0.0:1788836144.583878:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788836144.583894:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538460928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836144.584073:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538460928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.584081:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788836144.585157:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538460928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.586170:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8452:1875730538461056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.586244:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.586281:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836144.586629:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461056 00000100:00100000:0.0:1788836144.586636:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461056 00000100:00100000:0.0:1788836144.586688:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788836144.586696:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8452:x1875730538461056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836144.587640:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8452:x1875730538461056:12345-0@lo:502:llog_process_th.0 Request processed in 941us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836144.587651:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788836144.588719:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8452:1875730538461056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836144.588887:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836144.588898:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836144.588901:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836144.588906:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836144.588957:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8452:1875730538461184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836144.589026:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.589066:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.589235:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461184 00000100:00100000:1.0:1788836144.589242:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461184 00000100:00100000:1.0:1788836144.589291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836144.589301:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8452:x1875730538461184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836144.590100:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8452:x1875730538461184:12345-0@lo:502:llog_process_th.0 Request processed in 798us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836144.590108:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788836144.590758:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8452:1875730538461184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836144.590797:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836144.590805:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836144.590807:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788836144.590811:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788836144.591159:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788836144.591177:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788836144.591187:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.591198:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836144.591230:0:5826:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788836144.591233:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd046738000 from 1 10000000:01000000:2.0:1788836144.591236:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788836144.591271:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.591279:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.591288:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.591307:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538461312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.591375:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.591405:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836144.591639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461312 00000100:00100000:3.0:1788836144.591646:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461312 00000100:00100000:3.0:1788836144.591712:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788836144.591720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538461312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836144.591734:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836144.591748:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90935a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909353 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.591785:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909353 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.591803:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909353 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836144.591811:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c000, rc 0) 00000100:00100000:3.0:1788836144.591858:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538461312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836144.591864:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788836144.592089:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538461312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836144.592102:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.592111:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836144.592158:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538461440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836144.592184:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836144.592204:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836144.592389:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461440 00000100:00100000:1.0:1788836144.592394:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461440 00000100:00100000:1.0:1788836144.592425:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788836144.592432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538461440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836144.592714:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538461440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (529us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836144.592722:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788836144.592752:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538461440:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788836144.592774:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788836144.592780:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836144.592798:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836144.912764:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836145.351275:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836145.351320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836145.351396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836145.351432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836145.351464:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512256 00000100:00100000:0.0:1788836145.351474:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512256 00000100:00100000:0.0:1788836145.351537:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512128 00000100:00100000:0.0:1788836145.351540:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512128 00000100:00100000:0.0:1788836145.351559:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836145.351568:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518512256:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1788836145.351641:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518512256:12345-192.168.203.52@tcp:400: Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836145.351649:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836145.351676:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836145.351683:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518512128:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1788836145.351726:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518512128:12345-192.168.203.52@tcp:400: Request processed in 43us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836145.351732:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:0.0:1788836145.351749:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836145.351753:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836145.351860:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518511872 00000100:00100000:3.0:1788836145.351864:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518511872 00000100:00100000:3.0:1788836145.351892:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:3.0:1788836145.351899:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+8:2353:x1875730518511872:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788836145.351925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+8:2353:x1875730518511872:12345-192.168.203.52@tcp:400: Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836145.351931:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:1.0:1788836145.352420:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512000 00000100:00100000:1.0:1788836145.352426:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512000 00000100:00080000:0.0:1788836145.352628:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836145.353575:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788836145.353604:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518512000:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788836145.353683:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518512000:12345-192.168.203.52@tcp:400: Request processed in 87us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836145.357019:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:0.0:1788836145.939253:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836146.960665:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836147.026213:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836147.026236:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538461568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836147.026482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836147.026612:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461568 00000100:00100000:1.0:1788836147.026816:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461568 00000100:00100000:1.0:1788836147.026883:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836147.026894:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538461568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836147.026930:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836147.027887:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538461568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 993us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836147.027896:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788836147.027947:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3ca80 x1875730538461568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836147.027981:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538461568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788836147.028111:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836147.029253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538461952:0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.029309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836147.029357:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836147.029364:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538461824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.029388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836147.029423:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461952 00000100:00100000:2.0:1788836147.029430:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461952 00000100:00100000:2.0:1788836147.029474:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461824 00000100:00100000:2.0:1788836147.029477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461824 00000100:00100000:2.0:1788836147.029495:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788836147.029702:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836147.029716:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836147.029725:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538461824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836147.029779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538461824:12345-0@lo:400:kworker.0 Request processed in 56us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836147.029786:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788836147.030069:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836147.030142:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836147.030148:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538461696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836147.030200:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538462208:0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836147.030250:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462080 00000100:00100000:1.0:1788836147.030255:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462080 00000100:00100000:1.0:1788836147.030286:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836147.030307:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538462080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030363:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538462080:12345-0@lo:400:kworker.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836147.030370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788836147.030387:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836147.030475:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030500:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462208 00000100:00100000:1.0:1788836147.030644:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462208 00000100:00100000:1.0:1788836147.030732:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836147.030740:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538462208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836147.030780:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538462208:12345-0@lo:400:kworker.0 Request processed in 40us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836147.030786:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788836147.030816:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30ea00 x1875730538462208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836147.030828:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538462208:0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.030893:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538461952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.030934:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538461952:12345-0@lo:400:kworker.0 Request processed in 1431us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836147.030940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836147.030983:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538461824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.030993:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538461952:0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.031023:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538461696 00000100:00100000:2.0:1788836147.031027:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538461696 00000100:00100000:2.0:1788836147.031060:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788836147.031067:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836147.031100:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538461696:12345-0@lo:400:kworker.0 Request processed in 34us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836147.031107:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788836147.031242:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538461696:0@lo:400:kworker.0 00000100:00080000:0.0:1788836147.032876:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836147.536749:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538462336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836147.536816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836147.536949:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462336 00000100:00100000:1.0:1788836147.536956:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462336 00000100:00100000:1.0:1788836147.537000:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836147.537008:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538462336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836147.537042:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836147.537096:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538462336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836147.537103:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788836147.537245:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30d500 x1875730538462336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836147.537262:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538462336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836147.984589:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836149.009793:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836149.446482:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836149.446968:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512384 00000100:00100000:2.0:1788836149.446978:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512384 00000100:00100000:2.0:1788836149.447044:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1788836149.447068:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+8:5592:x1875730518512384:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788836149.447085:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836149.447110:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047999000/0xcb5b7bc40b909361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a632 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836149.447138:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999000/0xcb5b7bc40b909361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a632 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836149.447149:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047999000/0xcb5b7bc40b909361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a632 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836149.447157:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999000, rc 0) 00000100:00100000:2.0:1788836149.447232:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518512384:12345-192.168.203.52@tcp:101: Request processed in 167us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836149.447239:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:0.0:1788836149.457509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836149.458059:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512512 00000100:00100000:1.0:1788836149.458072:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512512 00000100:00100000:1.0:1788836149.458259:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:1.0:1788836149.458299:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518512512:12345-192.168.203.52@tcp:501: 00000100:00100000:1.0:1788836149.458756:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518512512:12345-192.168.203.52@tcp:501: Request processed in 459us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836149.458766:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:0.0:1788836149.460821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836149.460934:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512640 00000100:00100000:3.0:1788836149.460947:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512640 00000100:00100000:3.0:1788836149.461022:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:3.0:1788836149.461033:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518512640:12345-192.168.203.52@tcp:503: 00000100:00100000:3.0:1788836149.461315:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518512640:12345-192.168.203.52@tcp:503: Request processed in 283us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836149.461324:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:3.0:1788836149.468058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836149.470158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512768 00000100:00100000:1.0:1788836149.470181:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512768 00000100:00100000:1.0:1788836149.470279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:1.0:1788836149.470292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:6090:x1875730518512768:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1788836149.471141:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:6090:x1875730518512768:12345-192.168.203.52@tcp:502: Request processed in 845us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836149.471153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:0.0:1788836149.473539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836149.473646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518512896 00000100:00100000:3.0:1788836149.473659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518512896 00000100:00100000:3.0:1788836149.473829:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:3.0:1788836149.473842:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+9:6090:x1875730518512896:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836149.474427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+9:6090:x1875730518512896:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 585us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836149.474437:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1788836149.480389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836149.480521:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513024 00000100:00100000:1.0:1788836149.480535:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513024 00000100:00100000:1.0:1788836149.480614:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1788836149.480627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518513024:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836149.480660:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836149.480686:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a639 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836149.480724:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a639 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836149.480737:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a639 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836149.480771:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377400, rc 0) 00000100:00100000:1.0:1788836149.480854:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513024:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 229us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836149.480871:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:0.0:1788836149.484651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836149.484756:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513152 00000100:00100000:3.0:1788836149.484769:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513152 00000100:00100000:3.0:1788836149.485100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788836149.485114:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513152:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836149.485814:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513152:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 698us (1184us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836149.485826:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00010000:00010000:0.0:1788836150.032838:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788836150.373608:0:8492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe54a02630 20000000:00000080:3.0:1788836150.373640:0:8492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd050415000 uarg=0000000000000000 20000000:01000000:3.0:1788836150.373688:0:8492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788836150.373695:0:8492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788836150.373702:0:8492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788836150.374843:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788836150.374937:0:8492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788836150.380719:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788836150.380787:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788836150.380851:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788836150.380875:0:8492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836150.380900:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.380922:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.380931:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.380948:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.380958:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.380967:0:8492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.381020:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.381040:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 9 pid: 5824 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.381058:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462464:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836150.381200:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.381210:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 18 pid: 5823 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.381220:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462592:0@lo:104: 00000100:00100000:2.0:1788836150.381271:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836150.381307:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.381315:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 18 pid: 5822 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.381336:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462720:0@lo:104: 00000100:00100000:2.0:1788836150.381395:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836150.381433:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.381442:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 18 pid: 5824 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.381451:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462848:0@lo:104: 00000100:00100000:2.0:1788836150.381472:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836150.381577:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788836150.381599:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836150.381612:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462592 00000100:00100000:0.0:1788836150.381620:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462592 00000100:00100000:0.0:1788836150.381679:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462720 00000100:00100000:0.0:1788836150.381682:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462720 00000100:00100000:0.0:1788836150.381694:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462848 00000100:00100000:0.0:1788836150.381696:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462848 00000100:00100000:0.0:1788836150.381709:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836150.381720:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8492:x1875730538462592:12345-0@lo:104: 00010000:00010000:0.0:1788836150.381731:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.381797:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836150.381804:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:8492:x1875730538462592:12345-0@lo:104: Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836150.381812:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836150.381836:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836150.381842:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8492:x1875730538462720:12345-0@lo:104: 00010000:00010000:0.0:1788836150.381850:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.381886:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788836150.381890:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:8492:x1875730538462720:12345-0@lo:104: Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836150.381903:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836150.381935:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836150.381942:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8492:x1875730538462848:12345-0@lo:104: 00010000:00010000:0.0:1788836150.381950:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.381991:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788836150.381997:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:8492:x1875730538462848:12345-0@lo:104: Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836150.382003:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788836150.382020:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788836150.382027:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382031:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836150.382035:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0cc00 already unused, calling callback (ffffffffc1bb3c20) 00010000:00010000:3.0:1788836150.382040:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836150.382042:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382057:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836150.382065:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836150.382071:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836150.382105:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382113:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836150.382124:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836150.382136:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382145:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382147:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836150.382159:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382161:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0cc00/0xcb5b7bc40b90920a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909211 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836150.382171:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836150.382185:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836150.382190:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382193:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382201:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1bb3c20) 00010000:00010000:3.0:1788836150.382203:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788836150.382207:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382216:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836150.382223:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382226:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836150.382232:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836150.382240:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90913f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909146 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382254:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836150.382255:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.382256:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836150.382259:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836150.382265:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836150.382274:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.382280:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9090dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9090e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836150.382288:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538462976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836150.382300:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836150.382310:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836150.382312:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836150.382322:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836150.382329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836150.382843:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462592:0@lo:104: 00000100:00100000:2.0:1788836150.382861:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462720:0@lo:104: 00000100:00100000:3.0:1788836150.382862:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538463104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836150.382875:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462848:0@lo:104: 00000100:00100000:3.0:1788836150.382900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836150.382926:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836150.382934:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538463232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836150.382938:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538462976 00000100:00100000:2.0:1788836150.382945:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538462976 00000100:00100000:3.0:1788836150.382958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836150.382977:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 19 pid: 5823 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.383006:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463104 00000100:00100000:2.0:1788836150.383009:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463104 00000100:00100000:3.0:1788836150.383017:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463232 00010000:00010000:2.0:1788836150.383022:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 20 pid: 5822 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836150.383024:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463232 00000100:00100000:2.0:1788836150.383042:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788836150.383047:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 21 pid: 5824 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836150.383053:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3305:x1875730538462976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836150.383069:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788836150.383071:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788836150.383077:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 21 pid: 5823 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836150.383084:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538463104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836150.383097:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836150.383102:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 21 pid: 5823 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.383104:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 21 pid: 5822 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836150.383168:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788836150.383181:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788836150.383313:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836150.383320:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538463232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836150.383329:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836150.383334:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 21 pid: 5824 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.383415:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b909211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90920a expref: 21 pid: 5823 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.384138:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 20 pid: 5822 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.384159:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 20 pid: 5824 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.384175:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9090e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9090dd expref: 20 pid: 5824 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.384190:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836150.384253:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538463232:12345-0@lo:103:ldlm_bl.0 Request processed in 932us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836150.384261:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788836150.384445:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836150.384531:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3305:x1875730538462976:12345-0@lo:103:ldlm_bl.0 Request processed in 1481us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836150.384538:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836150.384599:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538462976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836150.385096:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377c00/0xcb5b7bc40b909146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90913f expref: 17 pid: 5822 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836150.385111:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836150.385148:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3302:x1875730538463104:12345-0@lo:103:ldlm_bl.0 Request processed in 2069us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836150.385156:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836150.385279:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1875730538462464:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836150.385282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:2.0:1788836150.385317:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836150.385333:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538463232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836150.385366:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538463104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836150.385418:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513280 00000100:00100000:0.0:1788836150.385426:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513280 00010000:00010000:0.0:1788836150.385457:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836150.385488:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788836150.385497:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+10:2353:x1875730518513280:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836150.385531:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836150.385538:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385550:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385563:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376e00/0xcb5b7bc40b9092ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a601 expref: 10 pid: 5824 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385577:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385586:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385602:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385610:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385616:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385623:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385743:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836150.385756:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.385779:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.385953:0:8492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836150.385962:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.388324:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.388365:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998a00/0xcb5b7bc40b90936f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836150.388400:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836150.388503:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+9:2353:x1875730518513280:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3000us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836150.388514:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836150.477545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836150.477592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836150.478031:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513408 00000100:00100000:1.0:1788836150.478041:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513408 00000100:00100000:1.0:1788836150.478137:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788836150.478150:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518513408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836150.478166:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513664 00000100:00100000:3.0:1788836150.478172:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513664 00000100:00100000:3.0:1788836150.478241:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788836150.478252:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518513664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836150.478314:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518513664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 65us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836150.478322:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:2.0:1788836150.478340:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836150.478363:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836150.478728:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518513408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 579us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836150.478737:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836150.480210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836150.480546:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513536 00000100:00100000:1.0:1788836150.480556:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513536 00000100:00100000:1.0:1788836150.480616:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788836150.480626:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518513536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836150.480889:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518513536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 255us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836150.480899:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00080000:2.0:1788836150.481203:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836151.047583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836151.047618:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513792 00000100:00100000:1.0:1788836151.047639:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513792 00000100:00100000:0.0:1788836151.052792:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:0.0:1788836151.052812:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+9:5592:x1875730518513792:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836151.052833:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836151.052854:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a640 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836151.053318:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836151.053333:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836151.053365:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030e00, rc 0) 00000100:00100000:0.0:1788836151.053553:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513792:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 625us (5856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836151.053574:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00010000:00010000:3.0:1788836151.058480:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836151.059921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836151.060120:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518513920 00000100:00100000:3.0:1788836151.060130:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518513920 00000100:00100000:3.0:1788836151.060213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1788836151.060223:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513920:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836151.060535:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518513920:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 312us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836151.060543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:2.0:1788836151.070318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836151.070956:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514048 00000100:00100000:1.0:1788836151.071148:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514048 00000100:00100000:1.0:1788836151.071233:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:1.0:1788836151.071244:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518514048:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836151.071715:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:5592:x1875730518514048:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 470us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836151.071724:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:1.0:1788836151.079390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836151.080409:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514176 00000100:00100000:0.0:1788836151.080420:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514176 00000100:00100000:0.0:1788836151.080468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:0.0:1788836151.080478:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:6147:x1875730518514176:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836151.080724:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:6147:x1875730518514176:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 246us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836151.080732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:2.0:1788836151.089571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836151.090200:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514304 00000100:00100000:3.0:1788836151.090210:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514304 00000100:00100000:3.0:1788836151.090264:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:3.0:1788836151.090274:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:6147:x1875730518514304:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836151.093132:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:6147:x1875730518514304:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 2848us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836151.093269:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00010000:00010000:2.0:1788836152.080585:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836152.145593:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538463360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836152.145670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.145742:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463360 00000100:00100000:1.0:1788836152.145749:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463360 00000100:00100000:1.0:1788836152.145798:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836152.145807:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538463360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836152.145842:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836152.145885:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538463360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.145893:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788836152.145931:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd079abd880 x1875730538463360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836152.145949:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538463360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788836152.146738:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836152.148533:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.148595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.148651:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.148677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.148704:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836152.148710:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538463872:0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.148732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.148776:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463488 00000100:00100000:1.0:1788836152.148783:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463488 00000100:00100000:1.0:1788836152.148826:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788836152.148834:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3305:x1875730538463488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.148890:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3305:x1875730538463488:12345-0@lo:400:kworker.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.148898:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788836152.148946:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464000 00000100:00100000:1.0:1788836152.148950:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464000 00000100:00100000:1.0:1788836152.148984:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836152.148991:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.149023:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538464000:12345-0@lo:400:kworker.0 Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.149029:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836152.149048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463872 00000100:00100000:1.0:1788836152.149052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463872 00000100:00100000:1.0:1788836152.149083:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836152.149091:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538463872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.149135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538463872:12345-0@lo:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.149142:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836152.149154:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538463616:0@lo:400:kworker.0 00000100:00100000:1.0:1788836152.149189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538463872:0@lo:400:kworker.0 00000100:00080000:2.0:1788836152.149231:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836152.149236:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836152.149536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836152.149568:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836152.149578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538463744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836152.149598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.150485:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463616 00000100:00100000:2.0:1788836152.150493:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463616 00000100:00100000:2.0:1788836152.150721:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538463744 00000100:00100000:2.0:1788836152.150725:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538463744 00000100:00100000:2.0:1788836152.150751:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836152.150758:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538463616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836152.150815:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538463616:12345-0@lo:400:kworker.0 Request processed in 57us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.150822:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836152.150837:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836152.150843:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538463744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836152.150870:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538463744:12345-0@lo:400:kworker.0 Request processed in 28us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.150875:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788836152.150899:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836152.151458:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538463488:0@lo:400:kworker.0 00010000:00080000:1.0:1788836152.151478:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd079abf480 x1875730538464000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836152.151566:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538464000:0@lo:400:kworker.0 00000100:00100000:3.0:1788836152.154174:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538463744:0@lo:400:kworker.0 00000100:00100000:3.0:1788836152.154191:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538463616:0@lo:400:kworker.0 10000000:01000000:1.0:1788836152.400638:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836152.400645:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd079eb5000 from 4 10000000:01000000:1.0:1788836152.400649:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836152.400695:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836152.400707:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836152.400719:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836152.400742:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836152.400802:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.401007:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cff3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836152.401386:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464128 00000100:00100000:2.0:1788836152.401394:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464128 00000100:00100000:2.0:1788836152.401512:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788836152.401521:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538464128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836152.401534:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836152.401547:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90937d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.401588:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.401599:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.401607:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999e00, rc 0) 00000100:00100000:2.0:1788836152.401711:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.401718:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788836152.401828:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836152.401847:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836152.401856:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836152.402043:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836152.402074:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836152.402302:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836152.402746:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464256 00000100:00100000:1.0:1788836152.402753:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464256 00000100:00100000:1.0:1788836152.402837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788836152.402845:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836152.403561:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 714us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.403570:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788836152.403659:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836152.403699:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836152.403745:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836152.404056:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836152.404490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464384 00000100:00100000:2.0:1788836152.404497:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464384 00000100:00100000:2.0:1788836152.404531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788836152.404539:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.404729:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.404737:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788836152.405228:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836152.406406:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8602:1875730538464512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836152.406536:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836152.406575:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836152.406643:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464512 00000100:00100000:2.0:1788836152.406649:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464512 00000100:00100000:2.0:1788836152.406693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788836152.406701:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8602:x1875730538464512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836152.407009:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8602:x1875730538464512:12345-0@lo:502:llog_process_th.0 Request processed in 308us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.407017:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788836152.407101:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8602:1875730538464512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836152.407129:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836152.407139:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836152.407141:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836152.407148:0:8602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd079eb5000 00000020:00000080:0.0:1788836152.407151:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836152.407262:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8602:1875730538464640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836152.407296:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836152.407319:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04872bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836152.407608:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464640 00000100:00100000:1.0:1788836152.407614:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464640 00000100:00100000:1.0:1788836152.408288:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788836152.408300:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8602:x1875730538464640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836152.408849:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:8602:x1875730538464640:12345-0@lo:502:llog_process_th.0 Request processed in 550us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.408873:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788836152.408954:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8602:1875730538464640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836152.408981:0:8602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836152.408986:0:8602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836152.408989:0:8602:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788836152.408992:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788836152.409050:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788836152.409066:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836152.409075:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836152.409086:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836152.409105:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836152.409108:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd078fee000 from 4 10000000:01000000:3.0:1788836152.409111:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836152.409137:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836152.409145:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836152.409155:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836152.409172:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836152.409204:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836152.409401:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.409598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464768 00000100:00100000:0.0:1788836152.409606:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464768 00000100:00100000:0.0:1788836152.409643:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788836152.409650:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538464768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836152.409662:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836152.409678:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90938b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836152.409701:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836152.409711:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836152.409720:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031600, rc 0) 00000100:00100000:0.0:1788836152.409755:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538464768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.409761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788836152.409930:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836152.409944:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836152.409954:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836152.410001:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836152.410026:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836152.410091:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046707600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.412718:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538464896 00000100:00100000:0.0:1788836152.412731:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538464896 00000100:00100000:0.0:1788836152.412779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788836152.412788:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538464896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836152.413271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538464896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (3243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.413279:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788836152.413581:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a351f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538464896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.413650:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.413693:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.413764:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.413795:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465024 00000100:00100000:0.0:1788836152.413800:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465024 00000100:00100000:0.0:1788836152.413863:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788836152.413871:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538465024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836152.414022:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538465024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.414029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788836152.414083:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836152.415518:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8605:1875730538465152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836152.415573:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.415604:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836152.415642:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465152 00000100:00100000:1.0:1788836152.415647:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465152 00000100:00100000:1.0:1788836152.415684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788836152.415692:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8605:x1875730538465152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836152.415853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8605:x1875730538465152:12345-0@lo:502:llog_process_th.0 Request processed in 161us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.415872:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788836152.415915:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8605:1875730538465152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836152.415937:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836152.415945:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836152.415947:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788836152.415952:0:8605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd078fee000 00000020:00000080:1.0:1788836152.415954:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788836152.416022:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8605:1875730538465280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836152.416052:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836152.416066:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04577b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836152.416675:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465280 00000100:00100000:2.0:1788836152.416683:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465280 00000100:00100000:2.0:1788836152.416711:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788836152.416717:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8605:x1875730538465280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836152.416897:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:8605:x1875730538465280:12345-0@lo:502:llog_process_th.0 Request processed in 179us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.416904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788836152.416974:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8605:1875730538465280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836152.416997:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836152.417003:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836152.417005:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788836152.417008:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788836152.417083:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788836152.417102:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836152.417111:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.417234:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836152.417247:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836152.417250:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd0497a5800 from 4 10000000:01000000:2.0:1788836152.417415:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836152.417443:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.417451:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.417768:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836152.417787:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.417824:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.417863:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836152.417911:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465408 00000100:00100000:1.0:1788836152.417922:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465408 00000100:00100000:1.0:1788836152.417953:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788836152.417960:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538465408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836152.417970:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836152.417982:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909399 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836152.418003:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836152.418019:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836152.418026:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376800, rc 0) 00000100:00100000:1.0:1788836152.418068:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538465408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836152.418078:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788836152.418142:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836152.418154:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836152.418162:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836152.418206:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.418229:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.418250:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.418323:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465536 00000100:00100000:0.0:1788836152.418334:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465536 00000100:00100000:0.0:1788836152.418455:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788836152.418463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538465536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836152.418697:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538465536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.418704:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788836152.418794:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.418821:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.418868:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.418889:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94240 going to sleep for 11 seconds 00000100:00100000:2.0:1788836152.418901:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465664 00000100:00100000:2.0:1788836152.418905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465664 00000100:00100000:2.0:1788836152.418925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788836152.418931:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538465664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.419056:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538465664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.419069:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788836152.419103:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538465664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836152.419823:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8606:1875730538465792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836152.419909:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.419937:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.419982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465792 00000100:00100000:0.0:1788836152.419987:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465792 00000100:00100000:0.0:1788836152.420021:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788836152.420029:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:8606:x1875730538465792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836152.420169:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:8606:x1875730538465792:12345-0@lo:502:llog_process_th.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.420176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788836152.420601:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8606:1875730538465792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836152.420633:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836152.420642:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836152.420644:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788836152.420649:0:8606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd0497a5800 00000020:00000080:2.0:1788836152.420651:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836152.420717:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8606:1875730538465920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836152.420753:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.420772:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836152.421184:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538465920 00000100:00100000:0.0:1788836152.421190:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538465920 00000100:00100000:0.0:1788836152.421263:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788836152.421271:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:8606:x1875730538465920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836152.421448:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:8606:x1875730538465920:12345-0@lo:502:llog_process_th.0 Request processed in 177us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836152.421455:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788836152.422008:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:8606:1875730538465920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836152.422035:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836152.422041:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836152.422044:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788836152.422047:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788836152.422185:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788836152.422202:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836152.422212:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836152.422223:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836152.660070:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836152.660094:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538466048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836152.660161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836152.661189:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466048 00000100:00100000:2.0:1788836152.661199:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466048 00000100:00100000:2.0:1788836152.661262:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836152.661271:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538466048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836152.661310:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836152.661405:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538466048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836152.661425:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788836152.661571:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30f800 x1875730538466048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836152.661594:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538466048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836153.106760:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836154.129152:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836155.153540:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836155.401104:0:8792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788836155.594634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836155.594684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836155.594717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836155.594739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836155.594796:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514432 00000100:00100000:2.0:1788836155.594805:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514432 00000100:00100000:2.0:1788836155.594857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:2.0:1788836155.594867:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518514432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836155.594933:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518514432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836155.594941:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:2.0:1788836155.594971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514560 00000100:00100000:2.0:1788836155.594974:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514560 00000100:00100000:2.0:1788836155.595011:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788836155.595018:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518514560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836155.595047:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518514560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836155.595053:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788836155.595158:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514688 00000100:00100000:1.0:1788836155.595162:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514688 00000100:00100000:1.0:1788836155.595190:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514816 00000100:00100000:1.0:1788836155.595194:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514816 00000100:00100000:1.0:1788836155.595322:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788836155.595337:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518514688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1788836155.595370:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836155.595374:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836155.595377:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836155.595395:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518514688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836155.595402:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788836155.595415:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788836155.595421:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518514816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836155.595466:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518514816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836155.595472:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:2.0:1788836156.176548:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836157.203739:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836157.266748:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836157.266821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836157.266949:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466176 00000100:00100000:2.0:1788836157.266957:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466176 00000100:00100000:2.0:1788836157.267022:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836157.267032:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538466176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836157.267068:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836157.267119:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538466176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836157.267127:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788836157.267189:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788836157.267218:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30fb80 x1875730538466176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836157.267238:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538466176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836157.268886:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538466304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836157.268944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836157.269037:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466304 00000100:00100000:3.0:1788836157.269044:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466304 00000100:00100000:3.0:1788836157.269088:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788836157.269097:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538466304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836157.269203:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538466432:0@lo:400:kworker.0 00000100:00100000:1.0:1788836157.269237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836157.273710:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538466304:12345-0@lo:400:kworker.0 Request processed in 4604us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836157.273727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788836157.273833:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466432 00000100:00100000:3.0:1788836157.273842:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466432 00000100:00100000:3.0:1788836157.273888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836157.273898:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538466432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.273975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538466432:12345-0@lo:400:kworker.0 Request processed in 79us (4737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836157.273982:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836157.274031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538466432:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.275750:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538466560:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.275815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836157.275862:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836157.275869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.275894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836157.275926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466560 00000100:00100000:3.0:1788836157.275933:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466560 00000100:00100000:3.0:1788836157.275973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466688 00000100:00100000:3.0:1788836157.275976:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466688 00000100:00100000:3.0:1788836157.275999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836157.276007:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538466560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276055:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538466560:12345-0@lo:400:kworker.0 Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836157.276062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836157.276078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836157.276085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538466688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276113:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538466688:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836157.276119:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788836157.276138:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836157.276146:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836157.276154:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538466816:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836157.276206:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466816 00000100:00100000:3.0:1788836157.276210:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466816 00000100:00100000:3.0:1788836157.276242:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836157.276249:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538466816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276280:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538466816:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836157.276293:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788836157.276312:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788836157.276335:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3f800 x1875730538466816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836157.276394:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538466816:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276426:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.276436:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788836157.278622:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788836157.776534:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538466944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836157.776606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836157.776684:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538466944 00000100:00100000:1.0:1788836157.776692:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538466944 00000100:00100000:1.0:1788836157.776737:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836157.776744:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538466944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836157.776776:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836157.777999:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538466944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1248us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836157.778010:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788836157.781381:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30f100 x1875730538466944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836157.781408:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538466944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836158.224495:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836159.250784:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836159.504791:0:9035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing yml_node 00010000:00010000:3.0:1788836160.273924:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836160.717689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836160.717731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836160.717767:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836160.717843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836160.717928:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515072 00000100:00100000:0.0:1788836160.717938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515072 00000100:00100000:0.0:1788836160.718015:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836160.718025:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518515072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836160.718091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518515072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836160.718099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00080000:2.0:1788836160.718235:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836160.718445:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518514944 00000100:00100000:3.0:1788836160.718450:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518514944 00000100:00100000:3.0:1788836160.718487:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1788836160.718497:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518514944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836160.718536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518514944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836160.718542:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1788836160.718581:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515200 00000100:00100000:3.0:1788836160.718585:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515200 00000100:00100000:3.0:1788836160.718615:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515328 00000100:00100000:3.0:1788836160.718619:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515328 00000100:00100000:3.0:1788836160.718652:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788836160.718658:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2352:x1875730518515200:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788836160.718685:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9092dc 00000100:00080000:3.0:1788836160.718695:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836160.718731:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788836160.719072:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+2:2352:x1875730518515200:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 413us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836160.719080:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788836160.719094:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836160.719101:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2352:x1875730518515328:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788836160.719114:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9092e3 00000100:00080000:3.0:1788836160.719121:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836160.719143:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788836160.719323:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+2:2352:x1875730518515328:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 222us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836160.719330:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00010000:00010000:3.0:1788836160.719382:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836160.719387:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836160.719393:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836160.719396:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788836161.296939:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836162.323184:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836162.386393:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836162.386417:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836162.386490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836162.386613:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467072 00000100:00100000:2.0:1788836162.386621:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467072 00000100:00100000:2.0:1788836162.386683:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836162.386692:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538467072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836162.386727:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836162.386774:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538467072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836162.386781:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836162.386812:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836162.386843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836162.386884:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836162.386891:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538467456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836162.386900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467328 00000100:00100000:1.0:1788836162.386905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467328 00000100:00100000:2.0:1788836162.386917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836162.387078:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538467584:0@lo:400:kworker.0 00000100:00100000:3.0:1788836162.387106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836162.387142:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836162.387156:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538467200:0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.387197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836162.387221:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538467712:0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.387244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788836162.387282:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30dc00 x1875730538467072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836162.387300:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836162.387328:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467712 00000100:00100000:0.0:1788836162.387332:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467712 00000100:00100000:0.0:1788836162.387384:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788836162.387391:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538467712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.387436:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538467712:12345-0@lo:400:kworker.0 Request processed in 46us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836162.387443:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788836162.387457:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788836162.387472:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb6680 x1875730538467712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836162.387482:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538467712:0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.387514:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467200 00000100:00100000:0.0:1788836162.387518:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467200 00000100:00100000:0.0:1788836162.387542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788836162.387547:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538467200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.387593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538467200:12345-0@lo:400:kworker.0 Request processed in 45us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836162.387599:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788836162.387633:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538467200:0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.391741:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467456 00000100:00100000:1.0:1788836162.391750:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467584 00000100:00100000:0.0:1788836162.391755:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467456 00000100:00100000:1.0:1788836162.391757:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467584 00000100:00100000:1.0:1788836162.391809:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836162.391885:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538467328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836162.391983:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538467328:12345-0@lo:400:kworker.0 Request processed in 166us (5139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836162.391990:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836162.392009:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836162.392047:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836162.392049:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538467584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836162.392059:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538467456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836162.392146:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538467584:0@lo:400:kworker.0 00000100:00080000:3.0:1788836162.392192:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836162.392229:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538467328:0@lo:400:kworker.0 00000100:00100000:0.0:1788836162.394368:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538467584:12345-0@lo:400:kworker.0 Request processed in 2343us (7252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836162.394381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836162.394421:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538467456:12345-0@lo:400:kworker.0 Request processed in 2362us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836162.394430:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836162.400521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538467456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836162.897695:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836162.897728:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538467840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836162.897822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836162.897981:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467840 00000100:00100000:2.0:1788836162.897992:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467840 00000100:00100000:2.0:1788836162.898066:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836162.898078:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538467840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836162.898123:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836162.898186:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538467840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836162.898193:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788836162.898327:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30e680 x1875730538467840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836162.898377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538467840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836163.346903:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788836163.532205:0:9228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.107 00010000:00010000:0.0:1788836164.372605:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836165.006478:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:3.0:1788836165.006488:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bcf448a0800/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:3.0:1788836165.006517:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf448a0800/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-OST0001 00000020:00000080:3.0:1788836165.006569:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf448a3000 for lustre-OST0001 00000001:00100000:3.0:1788836165.016957:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:3.0:1788836165.016968:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bcf448a5800/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:2.0:1788836165.017110:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf448a5800/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-OST0000 00000020:00000080:2.0:1788836165.017158:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf448a1000 for lustre-OST0000 00010000:00010000:3.0:1788836165.393956:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836165.831977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836165.832045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836165.832077:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515584 00000100:00100000:3.0:1788836165.832086:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515584 00000100:00100000:3.0:1788836165.832141:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788836165.832151:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518515584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836165.832238:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518515584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836165.832246:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00080000:3.0:1788836165.832265:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836165.832639:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515456 00000100:00100000:1.0:1788836165.832646:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515456 00000100:00100000:1.0:1788836165.832692:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788836165.832700:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836165.832739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836165.832746:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000001:02000400:0.0:1788836165.956829:0:9328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.107 00010000:00010000:1.0:1788836166.416795:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836167.440779:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836167.504575:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788836167.504590:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788836167.504650:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538468352:0@lo:400:kworker.0 00000100:00100000:2.0:1788836167.506935:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538468096:0@lo:400:kworker.0 00000100:00100000:1.0:1788836167.512252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836167.512272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836167.512332:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836167.512384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468224 00000100:00100000:3.0:1788836167.512392:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468224 00000100:00100000:1.0:1788836167.512398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836167.512431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468352 00000100:00100000:1.0:1788836167.512441:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468352 00000100:00100000:1.0:1788836167.512493:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788836167.512503:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538468352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836167.512566:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538468352:12345-0@lo:400:kworker.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836167.512573:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836167.512588:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836167.512593:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468736 00000100:00100000:3.0:1788836167.512595:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836167.512596:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468736 00000100:00100000:1.0:1788836167.512617:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836167.512623:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538468736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836167.512636:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538468224:12345-0@lo:400:kworker.0 Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836167.512642:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00002000:00000024:1.0:1788836167.512648:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788836167.512730:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb7b80 x1875730538468352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836167.512753:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538468352:0@lo:400:kworker.0 00000100:00080000:3.0:1788836167.512798:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836167.512803:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836167.513246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836167.513286:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788836167.513312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836167.513360:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468480 00000100:00100000:0.0:1788836167.513365:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468480 00000100:00100000:0.0:1788836167.513419:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836167.513426:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538468480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836167.513465:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538468480:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836167.513472:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788836167.513486:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836167.513508:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788836167.513557:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788836167.513834:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538467968 00000100:00100000:3.0:1788836167.513839:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538467968 00000100:00100000:3.0:1788836167.513876:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788836167.513883:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538467968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836167.513920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538467968:12345-0@lo:400:kworker.0 Request processed in 37us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836167.513926:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788836167.514071:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538467968:0@lo:400:kworker.0 00000100:00100000:2.0:1788836167.515149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836167.515188:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538468608:0@lo:400:kworker.0 00000100:00100000:2.0:1788836167.515216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836167.515316:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468096 00000100:00100000:3.0:1788836167.515323:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468096 00000100:00100000:3.0:1788836167.515397:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836167.515576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836167.515623:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538468096:12345-0@lo:400:kworker.0 Request processed in 51us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836167.515630:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836167.515697:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468608 00000100:00100000:0.0:1788836167.515702:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468608 00000100:00100000:0.0:1788836167.515821:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836167.515830:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538468608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836167.515865:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538468608:12345-0@lo:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836167.515872:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788836167.515958:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836167.516113:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538468096:0@lo:400:kworker.0 00010000:00080000:2.0:1788836167.516127:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb7480 x1875730538468608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836167.516136:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538468608:0@lo:400:kworker.0 00000100:00100000:1.0:1788836167.518674:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538468736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6042us (6266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836167.518687:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788836167.519556:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30e300 x1875730538468736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836167.519582:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538468736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836168.016953:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836168.016976:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538468864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836168.017044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836168.017146:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468864 00000100:00100000:1.0:1788836168.017156:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468864 00000100:00100000:1.0:1788836168.017209:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836168.017218:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538468864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836168.017262:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836168.017312:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538468864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836168.017319:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788836168.017464:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30dc00 x1875730538468864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836168.017483:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538468864:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788836168.443104:0:9425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.107 00010000:00010000:3.0:1788836168.466303:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836169.489028:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788836170.024744:0:9474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 22:56:07 EDT 2026 00010000:00010000:0.0:1788836170.513281:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836170.949565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836170.949625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836170.949673:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515840 00000100:00100000:3.0:1788836170.949682:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515840 00000100:00100000:3.0:1788836170.949745:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836170.949757:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518515840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836170.949851:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518515840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836170.949861:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00080000:3.0:1788836170.949888:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836170.950938:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515712 00000100:00100000:1.0:1788836170.950946:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515712 00000100:00100000:1.0:1788836170.951117:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:1.0:1788836170.951128:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836170.951199:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836170.951207:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00010000:00010000:3.0:1788836171.538885:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836172.567370:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836172.627811:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538468992:0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.627835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538469376:0@lo:400:kworker.0 00000100:00100000:2.0:1788836172.629396:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538469120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.629537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836172.629598:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538469504:0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.629624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836172.629625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836172.629971:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538469248:0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.630003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836172.630051:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469376 00000100:00100000:1.0:1788836172.630059:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469376 00000100:00100000:1.0:1788836172.630115:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836172.630124:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538469376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.630183:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538469376:12345-0@lo:400:kworker.0 Request processed in 60us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836172.630190:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788836172.630213:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469504 00000100:00100000:1.0:1788836172.630217:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469504 00000100:00100000:1.0:1788836172.630238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469248 00000100:00100000:1.0:1788836172.630241:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469248 00000100:00100000:1.0:1788836172.630260:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836172.630266:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538469504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.630297:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538469504:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836172.630302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836172.630313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836172.630318:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538469248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836172.630386:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538469248:12345-0@lo:400:kworker.0 Request processed in 67us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836172.630406:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788836172.630423:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836172.630427:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836172.630461:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538469248:0@lo:400:kworker.0 00010000:00080000:1.0:1788836172.630624:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0794e5f80 x1875730538469376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836172.630636:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538469376:0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.631077:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538469504:0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.631108:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538468992 00000100:00100000:3.0:1788836172.631112:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538468992 00000100:00100000:3.0:1788836172.631144:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788836172.631151:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538468992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.631193:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538468992:12345-0@lo:400:kworker.0 Request processed in 43us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836172.631199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788836172.631250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538468992:0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.633236:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836172.633301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836172.633383:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469760 00000100:00100000:3.0:1788836172.633390:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469760 00000100:00100000:3.0:1788836172.633436:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788836172.633445:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538469760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836172.633480:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836172.633540:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538469760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836172.633548:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788836172.633587:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae59500 x1875730538469760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836172.633608:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538469760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836172.635013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836172.635061:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538469632:0@lo:400:kworker.0 00000100:00100000:2.0:1788836172.635100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836172.635326:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469632 00000100:00100000:3.0:1788836172.635368:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469632 00000100:00100000:3.0:1788836172.635429:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788836172.635437:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538469632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836172.635503:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538469632:12345-0@lo:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836172.635510:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788836172.635665:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788836172.635695:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0794e4000 x1875730538469632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836172.635726:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538469632:0@lo:400:kworker.0 00000100:00100000:0.0:1788836172.636194:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469120 00000100:00100000:0.0:1788836172.636200:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469120 00000100:00100000:0.0:1788836172.636246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836172.636254:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836172.636318:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538469120:12345-0@lo:400:kworker.0 Request processed in 66us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836172.636324:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836172.636585:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538469120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836173.138494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836173.138527:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538469888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836173.138647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836173.138953:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538469888 00000100:00100000:2.0:1788836173.138964:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538469888 00000100:00100000:2.0:1788836173.139029:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836173.139040:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538469888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836173.139090:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836173.139267:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538469888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836173.139275:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788836173.139378:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30f800 x1875730538469888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836173.139399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538469888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836173.585510:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836174.612408:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836175.633368:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836176.070116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836176.070173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836176.070262:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516096 00000100:00100000:2.0:1788836176.070271:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516096 00000100:00100000:2.0:1788836176.070336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788836176.070371:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518516096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836176.070442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518516096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836176.070449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788836176.070595:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518515968 00000100:00100000:0.0:1788836176.070600:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518515968 00000100:00100000:0.0:1788836176.070638:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:0.0:1788836176.070645:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836176.070672:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518515968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836176.070678:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00080000:3.0:1788836176.071023:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836176.657391:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836177.680888:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836177.744550:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836177.744626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836177.744741:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470016 00000100:00100000:3.0:1788836177.744749:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470016 00000100:00100000:3.0:1788836177.744808:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836177.744816:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538470016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836177.744849:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836177.744886:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538470016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836177.744893:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788836177.744945:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836177.744969:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae58e00 x1875730538470016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836177.744987:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836177.746759:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538470272:0@lo:400:kworker.0 00000100:00100000:3.0:1788836177.746816:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836177.746848:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788836177.746854:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788836177.746917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836177.746939:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.746984:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470272 00000100:00100000:0.0:1788836177.746991:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470272 00000100:00100000:0.0:1788836177.747031:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836177.747038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538470272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747082:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538470272:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836177.747088:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836177.747110:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836177.747145:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836177.747150:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836177.747216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836177.747223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470400 00000100:00100000:0.0:1788836177.747227:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470400 00000100:00100000:0.0:1788836177.747254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470528 00000100:00100000:0.0:1788836177.747256:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470528 00000100:00100000:0.0:1788836177.747271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836177.747275:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538470400:12345-0@lo:400:kworker.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836177.747371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836177.747391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788836177.747396:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747419:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538470528:12345-0@lo:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836177.747424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788836177.747441:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836177.747468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747479:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747595:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470656 00000100:00100000:0.0:1788836177.747599:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470656 00000100:00100000:0.0:1788836177.747625:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836177.747630:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538470656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836177.747658:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538470656:12345-0@lo:400:kworker.0 Request processed in 28us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836177.747664:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788836177.747677:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836177.747710:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538470272:0@lo:400:kworker.0 00010000:00080000:3.0:1788836177.747729:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae5ad80 x1875730538470656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836177.747742:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788836177.747757:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470144 00000100:00100000:3.0:1788836177.747765:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470144 00000100:00100000:3.0:1788836177.747793:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788836177.747799:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538470144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836177.747828:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538470144:12345-0@lo:400:kworker.0 Request processed in 30us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836177.747833:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788836177.747859:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538470144:0@lo:400:kworker.0 00000100:00100000:0.0:1788836178.256650:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538470784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836178.256720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836178.256934:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470784 00000100:00100000:3.0:1788836178.256941:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470784 00000100:00100000:3.0:1788836178.256990:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836178.256998:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538470784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836178.257038:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836178.257080:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538470784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836178.257086:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788836178.257122:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae58700 x1875730538470784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836178.257139:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538470784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836178.709982:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836179.729658:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836180.756208:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836181.193329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836181.193368:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516352 00000100:00100000:0.0:1788836181.193377:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516352 00000100:00100000:3.0:1788836181.193387:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836181.193447:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788836181.193458:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518516352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836181.193535:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518516352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836181.193542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00080000:0.0:1788836181.193583:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836181.194862:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516224 00000100:00100000:2.0:1788836181.194874:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516224 00000100:00100000:2.0:1788836181.194919:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:2.0:1788836181.194928:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2353:x1875730518516224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836181.194997:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:2353:x1875730518516224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836181.195015:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00010000:00010000:2.0:1788836181.778529:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836182.800762:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836182.864514:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836182.864585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.864661:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538470912 00000100:00100000:0.0:1788836182.864668:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538470912 00000100:00100000:0.0:1788836182.864720:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836182.864729:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538470912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836182.864762:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836182.864803:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538470912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.864809:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788836182.864831:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836182.864862:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd079abf800 x1875730538470912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836182.864880:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836182.868930:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869078:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869135:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836182.869143:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538471296:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869215:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471168 00000100:00100000:0.0:1788836182.869222:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471168 00000100:00100000:0.0:1788836182.869263:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471296 00000100:00100000:0.0:1788836182.869266:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471296 00000100:00100000:0.0:1788836182.869307:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836182.869316:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538471168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869397:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538471168:12345-0@lo:400:kworker.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.869404:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836182.869431:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836182.869438:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538471296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869469:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538471296:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.869476:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836182.869498:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471680 00000100:00100000:0.0:1788836182.869503:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471680 00000100:00100000:0.0:1788836182.869529:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836182.869535:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869569:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538471680:12345-0@lo:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.869574:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788836182.869604:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836182.869609:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836182.869620:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538471424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869670:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788836182.869676:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538471040:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869728:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538471552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836182.869808:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471424 00000100:00100000:0.0:1788836182.869812:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471424 00000100:00100000:0.0:1788836182.869838:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836182.869844:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538471424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869893:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538471424:12345-0@lo:400:kworker.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.869900:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836182.869919:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471040 00000100:00100000:0.0:1788836182.869922:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471040 00000100:00100000:0.0:1788836182.869945:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788836182.869951:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.869981:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538471040:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.869986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788836182.870029:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471552 00000100:00100000:0.0:1788836182.870033:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471552 00000100:00100000:0.0:1788836182.870063:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836182.870068:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.870094:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538471552:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836182.870100:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788836182.870113:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836182.870138:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538471296:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.870150:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538471168:0@lo:400:kworker.0 00010000:00080000:0.0:1788836182.870160:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd04674c700 x1875730538471680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836182.870182:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.870216:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538471040:0@lo:400:kworker.0 00000100:00100000:0.0:1788836182.870225:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538471552:0@lo:400:kworker.0 00010000:00080000:0.0:1788836182.870234:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454b9880 x1875730538471424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836182.870242:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538471424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836183.380721:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836183.380791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836183.380918:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471808 00000100:00100000:3.0:1788836183.380926:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471808 00000100:00100000:3.0:1788836183.380981:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836183.380991:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836183.381032:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836183.381193:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836183.381200:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788836183.381259:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30d500 x1875730538471808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836183.381278:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538471808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836183.825297:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836184.848537:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836185.609806:0:10105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:56:22 (1788836182) === 00010000:00010000:3.0:1788836185.872757:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836185.993278:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836185.993379:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516480 00000100:00100000:2.0:1788836185.993468:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516480 00000100:00100000:2.0:1788836185.993588:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:2.0:1788836185.993599:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+10:8147:x1875730518516480:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836185.993618:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836185.993636:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b9093a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a647 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836185.993666:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b9093a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a647 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836185.993678:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b9093a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a647 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836185.993688:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998400, rc 0) 00000100:00100000:2.0:1788836185.993749:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518516480:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 152us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836185.993756:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:3.0:1788836186.003374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836186.003597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516608 00000100:00100000:0.0:1788836186.003608:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516608 00000100:00100000:0.0:1788836186.003662:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:0.0:1788836186.003673:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518516608:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836186.004108:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518516608:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 435us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836186.004117:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1788836186.014218:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.014318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516736 00000100:00100000:2.0:1788836186.014327:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516736 00000100:00100000:2.0:1788836186.014427:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788836186.014437:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518516736:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836186.014855:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518516736:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 418us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.014953:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788836186.022670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836186.022771:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516864 00000100:00100000:0.0:1788836186.022781:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516864 00000100:00100000:0.0:1788836186.022846:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1788836186.022857:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+11:8151:x1875730518516864:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836186.023171:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+11:8151:x1875730518516864:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 314us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836186.023180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:3.0:1788836186.043535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.045888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518516992 00000100:00100000:2.0:1788836186.045904:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518516992 00000100:00100000:2.0:1788836186.045987:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1788836186.045998:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:8151:x1875730518516992:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836186.046286:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:8151:x1875730518516992:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 289us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.046295:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:1.0:1788836186.051588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.051700:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517120 00000100:00100000:2.0:1788836186.051722:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517120 00000100:00100000:2.0:1788836186.051794:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:2.0:1788836186.051806:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+11:8147:x1875730518517120:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836186.051823:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836186.051840:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b9093ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a671 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.051870:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b9093ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a671 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.051881:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b9093ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a671 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.051890:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998e00, rc 0) 00000100:00100000:2.0:1788836186.052114:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:8147:x1875730518517120:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 309us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.052139:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:3.0:1788836186.061588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836186.062160:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517248 00000100:00100000:0.0:1788836186.062172:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517248 00000100:00100000:0.0:1788836186.062227:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:0.0:1788836186.062237:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+12:8147:x1875730518517248:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788836186.062262:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788836186.062285:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788836186.062289:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788836186.062292:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788836186.062295:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788836186.063785:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+12:8147:x1875730518517248:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 1542us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836186.063797:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1788836186.067517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.067607:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517376 00000100:00100000:2.0:1788836186.067618:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517376 00000100:00100000:2.0:1788836186.067677:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:2.0:1788836186.067687:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:8147:x1875730518517376:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836186.067710:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836186.067727:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a678 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.067767:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.067779:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836186.067788:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836186.067846:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:8147:x1875730518517376:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 161us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.067853:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:3.0:1788836186.070632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836186.070778:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517504 00000100:00100000:0.0:1788836186.070786:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517504 00000100:00100000:0.0:1788836186.070839:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:0.0:1788836186.070848:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:8147:x1875730518517504:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836186.071152:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:8147:x1875730518517504:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 303us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836186.071161:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1788836186.075336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836186.075494:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517632 00000100:00100000:3.0:1788836186.075504:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517632 00000100:00100000:3.0:1788836186.075556:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:3.0:1788836186.075567:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:8147:x1875730518517632:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788836186.075912:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:8147:x1875730518517632:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 345us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836186.075920:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:1.0:1788836186.088928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.089079:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517760 00000100:00100000:2.0:1788836186.089089:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517760 00000100:00100000:2.0:1788836186.089145:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1788836186.089162:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:8156:x1875730518517760:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836186.089623:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:8156:x1875730518517760:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 468us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.089632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1788836186.100726:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836186.101025:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518517888 00000100:00100000:0.0:1788836186.101035:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518517888 00000100:00100000:0.0:1788836186.101094:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:0.0:1788836186.101104:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:8156:x1875730518517888:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836186.101536:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:8156:x1875730518517888:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 431us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836186.101545:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:1.0:1788836186.110589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836186.110633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.110850:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518144 00000100:00100000:2.0:1788836186.110868:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518144 00000100:00100000:2.0:1788836186.110942:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518016 00000100:00100000:2.0:1788836186.110946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518016 00000100:00100000:2.0:1788836186.111012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788836186.111023:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518518144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836186.111101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518518144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.111109:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788836186.111126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788836186.111131:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875730518518016:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788836186.111152:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5@192.168.203.52@tcp t0 exp 0000000000000000 cur 239 last 0 00000100:00080000:1.0:1788836186.111424:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788836186.111953:0:5831:0:(genops.c:1385:class_connect()) connect: client 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5, cookie 0xcb5b7bc40b9093bc 00000004:00100000:2.0:1788836186.111984:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788836186.113072:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9bcf45111800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836186.115282:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2352:x1875730518518016:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 4137us (4637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.115296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836186.143839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836186.143880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836186.144049:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518400 00000100:00100000:3.0:1788836186.144060:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518400 00000100:00100000:3.0:1788836186.144132:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518272 00000100:00100000:3.0:1788836186.144136:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518272 00000100:00100000:3.0:1788836186.144157:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836186.144167:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+7:8147:x1875730518518400:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836186.144209:0:8192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788836186.144310:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+7:8147:x1875730518518400:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 143us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836186.144317:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836186.144335:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788836186.144363:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:0:x1875730518518272:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836186.144376:0:8192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788836186.144414:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:0:x1875730518518272:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 73us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836186.144419:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:1.0:1788836186.144614:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836186.150051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836186.152250:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518528 00000100:00100000:3.0:1788836186.152265:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518528 00000100:00100000:3.0:1788836186.152660:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836186.152673:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:8147:x1875730518518528:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788836186.152760:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:8147:x1875730518518528:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 89us (2719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836186.152767:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836186.162627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836186.162672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836186.162717:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836186.162785:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518656 00000100:00100000:2.0:1788836186.162798:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518656 00000100:00100000:2.0:1788836186.162845:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518784 00000100:00100000:2.0:1788836186.162848:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518784 00000100:00100000:2.0:1788836186.162864:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836186.162873:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875730518518656:12345-192.168.203.52@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788836186.162875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518518912 00000100:00100000:1.0:1788836186.162883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518518912 00010000:00080000:2.0:1788836186.162906:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5@192.168.203.52@tcp t0 exp 0000000000000000 cur 239 last 0 00000100:00100000:1.0:1788836186.162932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836186.162943:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:8147:x1875730518518912:12345-192.168.203.52@tcp:33:mount.lustre.0 00000020:00000080:2.0:1788836186.162956:0:6681:0:(genops.c:1385:class_connect()) connect: client 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5, cookie 0xcb5b7bc40b9093c3 00002000:00100000:2.0:1788836186.162972:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5/ffff9bcf45110000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836186.162996:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1788836186.163029:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788836186.163125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:8147:x1875730518518912:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 183us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836186.163136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00080000:2.0:1788836186.163293:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788836186.163322:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bcf45115800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836186.163416:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2352:x1875730518518656:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 543us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.163425:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836186.163440:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788836186.163445:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875730518518784:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788836186.163462:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5@192.168.203.52@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788836186.163482:0:6681:0:(genops.c:1385:class_connect()) connect: client 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5, cookie 0xcb5b7bc40b9093ca 00002000:00100000:2.0:1788836186.163488:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5/ffff9bcf45114000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836186.163503:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788836186.163628:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836186.163654:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bcf45116800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836186.163677:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2352:x1875730518518784:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 231us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836186.163684:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:3.0:1788836186.900929:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836187.924609:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836187.984993:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538471936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836187.985059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836187.988963:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538471936 00000100:00100000:2.0:1788836187.988973:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538471936 00000100:00100000:2.0:1788836187.989049:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836187.989059:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538471936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836187.989099:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836187.989199:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538471936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836187.989207:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836187.989236:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538472448:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788836187.989335:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b178000 x1875730538471936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836187.989377:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538471936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836187.989406:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836187.989411:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538472064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836187.989462:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538472576:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836187.989508:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538472320:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836187.989547:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836187.989552:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538472192:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836187.989648:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836187.989662:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472448 00000100:00100000:2.0:1788836187.989666:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472448 00000100:00100000:2.0:1788836187.989697:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472320 00000100:00100000:2.0:1788836187.989700:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472320 00000100:00100000:2.0:1788836187.989713:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472192 00000100:00100000:2.0:1788836187.989714:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472192 00000100:00100000:2.0:1788836187.989726:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836187.989731:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538472448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538472448:12345-0@lo:400:kworker.0 Request processed in 46us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836187.989784:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836187.989797:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836187.989802:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538472320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989832:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538472320:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836187.989838:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836187.989849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836187.989855:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538472192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989879:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538472192:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836187.989885:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836187.989900:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472576 00000100:00100000:2.0:1788836187.989903:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472576 00000100:00100000:2.0:1788836187.989928:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836187.989934:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538472576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.989963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538472576:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836187.989969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788836187.989988:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836187.989991:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836187.990024:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538472192:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.990034:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538472320:0@lo:400:kworker.0 00010000:00080000:2.0:1788836187.990063:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b255880 x1875730538472576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836187.990079:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538472576:0@lo:400:kworker.0 00000100:00100000:2.0:1788836187.990091:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538472448:0@lo:400:kworker.0 00000100:00100000:3.0:1788836187.990448:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472064 00000100:00100000:3.0:1788836187.990452:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472064 00000100:00100000:3.0:1788836187.990483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788836187.990490:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538472064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836187.990535:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538472064:12345-0@lo:400:kworker.0 Request processed in 46us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836187.990548:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788836187.994955:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538472064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836188.497824:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538472704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836188.497893:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836188.498061:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472704 00000100:00100000:0.0:1788836188.498069:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472704 00000100:00100000:0.0:1788836188.498120:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788836188.498129:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538472704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836188.498172:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836188.501976:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538472704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3838us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836188.501990:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788836188.504665:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae59c00 x1875730538472704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836188.505299:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538472704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836188.944541:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836189.968818:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836190.598468:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000001:00100000:3.0:1788836190.611516:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000001:00100000:3.0:1788836190.633523:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00010000:00010000:3.0:1788836190.992651:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836191.431120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836191.431164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836191.431194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836191.431221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836191.431246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836191.431270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519296 00000100:00100000:3.0:1788836191.431278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519296 00000100:00100000:3.0:1788836191.431321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519168 00000100:00100000:3.0:1788836191.431324:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519168 00000100:00100000:3.0:1788836191.431377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788836191.431391:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836191.431457:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836191.431464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788836191.431478:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788836191.431483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518519168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836191.431501:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518519168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 18us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836191.431506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788836191.431533:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519552 00000100:00100000:3.0:1788836191.431536:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519552 00000100:00100000:3.0:1788836191.431554:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519424 00000100:00100000:3.0:1788836191.431556:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519424 00000100:00100000:3.0:1788836191.431569:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836191.431574:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836191.431595:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836191.431601:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836191.431609:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788836191.431614:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836191.431631:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 17us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836191.431636:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00080000:3.0:1788836191.431649:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836191.431652:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836191.431655:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836191.431975:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519040 00000100:00100000:2.0:1788836191.431979:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519040 00000100:00100000:2.0:1788836191.432006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:2.0:1788836191.432012:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518519040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836191.432048:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518519040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836191.432054:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00010000:00010000:0.0:1788836192.016576:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836192.063652:0:10302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788836193.042813:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836193.110809:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538472832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.110819:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538472960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.110895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836193.110924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836193.110940:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538473472:0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.110952:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.110963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836193.110971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836193.110982:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836193.110982:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836193.110988:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.110988:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538473088:0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.111007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836193.111007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836193.111047:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472960 00000100:00100000:3.0:1788836193.111056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472960 00000100:00100000:3.0:1788836193.111108:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473344 00000100:00100000:3.0:1788836193.111112:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473344 00000100:00100000:3.0:1788836193.111135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473088 00000100:00100000:3.0:1788836193.111137:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473088 00000100:00100000:3.0:1788836193.111155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836193.111164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538472960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.111234:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836193.111243:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538473344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.111289:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538473344:12345-0@lo:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836193.111296:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836193.111319:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836193.111325:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.111387:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538473088:12345-0@lo:400:kworker.0 Request processed in 61us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836193.111393:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836193.111427:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538473088:0@lo:400:kworker.0 00000100:00100000:0.0:1788836193.111483:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538473344:0@lo:400:kworker.0 00000100:00100000:1.0:1788836193.111592:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538473600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836193.111624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836193.111658:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473600 00000100:00100000:1.0:1788836193.111661:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473600 00000100:00100000:1.0:1788836193.111695:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836193.111703:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538473600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836193.111731:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836193.111765:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538473600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836193.111772:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788836193.111800:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b17b100 x1875730538473600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836193.111815:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538473600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836193.112934:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538472960:12345-0@lo:400:kworker.0 Request processed in 1766us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836193.112946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836193.112978:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538472832 00000100:00100000:3.0:1788836193.112982:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538472832 00000100:00100000:3.0:1788836193.113021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788836193.113028:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.113083:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538472832:12345-0@lo:400:kworker.0 Request processed in 54us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836193.113089:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788836193.113118:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473472 00000100:00100000:3.0:1788836193.113122:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473472 00000100:00100000:3.0:1788836193.113148:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473216 00000100:00100000:3.0:1788836193.113152:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473216 00000100:00100000:3.0:1788836193.113165:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836193.113171:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538473472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.113572:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538473472:12345-0@lo:400:kworker.0 Request processed in 33us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836193.113581:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836193.113594:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836193.113601:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538473216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.113645:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538473216:12345-0@lo:400:kworker.0 Request processed in 45us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836193.113650:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788836193.113677:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836193.113681:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836193.113683:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836193.114176:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a422680 x1875730538473216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836193.114191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788836193.114213:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538472832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.115968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538472960:0@lo:400:kworker.0 00010000:00080000:3.0:1788836193.117145:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a423480 x1875730538473472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836193.117160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538473472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836193.616875:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538473728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836193.616953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836193.618745:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473728 00000100:00100000:1.0:1788836193.618761:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473728 00000100:00100000:1.0:1788836193.618820:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788836193.618831:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538473728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836193.618867:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836193.618948:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538473728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836193.618972:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788836193.619021:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0794e6300 x1875730538473728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836193.619041:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538473728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836194.064541:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836195.088586:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836196.114086:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836196.550450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836196.550544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836196.550576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836196.550606:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836196.550657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519680 00000100:00100000:1.0:1788836196.550667:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519680 00000100:00100000:1.0:1788836196.550717:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:1.0:1788836196.550729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518519680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836196.550807:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518519680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836196.550815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:0.0:1788836196.551169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520064 00000100:00100000:0.0:1788836196.551175:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520064 00000100:00100000:0.0:1788836196.551228:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788836196.551236:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518520064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836196.551268:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518520064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836196.551275:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00080000:1.0:1788836196.551516:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836196.552251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836196.552380:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520192 00000100:00100000:3.0:1788836196.552387:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520192 00000100:00100000:3.0:1788836196.552430:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788836196.552438:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518520192:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836196.552482:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518520192:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836196.552501:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00080000:3.0:1788836196.552536:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836196.553519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519808 00000100:00100000:2.0:1788836196.553529:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519808 00000100:00100000:0.0:1788836196.553587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518519936 00000100:00100000:0.0:1788836196.553592:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518519936 00000100:00100000:1.0:1788836196.553718:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1788836196.553728:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518519808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836196.553783:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518519808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 57us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836196.553791:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00080000:3.0:1788836196.554046:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836196.556064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788836196.556076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1788836196.556157:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836196.556265:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518519936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 191us (5657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836196.556273:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:3.0:1788836197.143207:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836198.163880:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836198.225933:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538474240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.226029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.226098:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836198.226104:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.226130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.226154:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538474368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.226178:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.226213:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538474112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.226252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.226274:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836198.226279:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538473984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.226302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836198.226309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474368 00000100:00100000:1.0:1788836198.226316:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538474496:0@lo:400:kworker.0 00000100:00100000:2.0:1788836198.226331:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474368 00000100:00100000:3.0:1788836198.226432:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474240 00000100:00100000:3.0:1788836198.226436:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474240 00000100:00100000:0.0:1788836198.226560:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474112 00000100:00100000:0.0:1788836198.226564:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474112 00000100:00100000:2.0:1788836198.226831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473984 00000100:00100000:2.0:1788836198.226836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473984 00000100:00100000:2.0:1788836198.226855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836198.226866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836198.226937:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538474368:12345-0@lo:400:kworker.0 Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836198.226945:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836198.226964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836198.226970:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836198.226997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538473984:12345-0@lo:400:kworker.0 Request processed in 28us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836198.227002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836198.227032:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538473856 00000100:00100000:2.0:1788836198.227035:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538473856 00000100:00100000:2.0:1788836198.227062:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788836198.227068:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836198.227099:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538473856:12345-0@lo:400:kworker.0 Request processed in 31us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836198.227104:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788836198.227139:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836198.227150:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538474624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836198.227179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.227502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.227552:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538473984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836198.227569:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474496 00000100:00100000:3.0:1788836198.227572:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474496 00000100:00100000:3.0:1788836198.227591:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836198.227598:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538474240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.227599:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474624 00000100:00100000:1.0:1788836198.227601:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474624 00000100:00100000:1.0:1788836198.227627:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836198.227633:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538474624:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836198.227637:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538474240:12345-0@lo:400:kworker.0 Request processed in 40us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836198.227643:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836198.227655:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836198.227660:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538474496:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788836198.227668:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836198.227689:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538474496:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836198.227695:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836198.227701:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538474624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836198.227707:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788836198.227727:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0794e4000 x1875730538474496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788836198.227729:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b17aa00 x1875730538474624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836198.227739:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538474496:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.227744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538474624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836198.227796:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.227810:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538474368:0@lo:400:kworker.0 00010000:00080000:1.0:1788836198.227819:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0794e4380 x1875730538474240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836198.227828:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538474240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.230755:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788836198.230820:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836198.230856:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836198.230861:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836198.231080:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538474112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.231213:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538474112:12345-0@lo:400:kworker.0 Request processed in 147us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836198.232940:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538474112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836198.234821:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836198.737074:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836198.737109:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538474752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836198.737214:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836198.737424:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474752 00000100:00100000:1.0:1788836198.737435:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474752 00000100:00100000:1.0:1788836198.737528:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836198.737544:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538474752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836198.737598:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836198.737667:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538474752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836198.737675:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788836198.737817:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb0a80 x1875730538474752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836198.737839:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538474752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836199.186750:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836200.211696:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836201.232863:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836201.670764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836201.670840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836201.670867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836201.670885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836201.671807:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520704 00000100:00100000:3.0:1788836201.671819:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520704 00000100:00100000:3.0:1788836201.671875:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788836201.671884:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836201.671953:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836201.671960:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788836201.671981:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520320 00000100:00100000:3.0:1788836201.671985:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520320 00000100:00100000:3.0:1788836201.672006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:3.0:1788836201.672012:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518520320:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836201.672033:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518520320:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836201.672040:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:0.0:1788836201.673157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836201.674579:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520832 00000100:00100000:3.0:1788836201.674591:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520832 00000100:00100000:3.0:1788836201.674671:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788836201.674680:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836201.674755:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836201.674762:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1788836201.677753:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520448 00000100:00100000:2.0:1788836201.677767:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520448 00000100:00100000:2.0:1788836201.677840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520576 00000100:00100000:2.0:1788836201.677844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520576 00000100:00100000:2.0:1788836201.677877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788836201.677886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518520448:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836201.677958:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518520448:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (7206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836201.677966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788836201.677983:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788836201.677989:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520576:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836201.678010:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518520576:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (7124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836201.678036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00080000:2.0:1788836201.678061:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836201.678065:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836201.678068:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836202.256496:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836203.285735:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836203.344538:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538474880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836203.344602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836203.344681:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538474880 00000100:00100000:1.0:1788836203.344688:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538474880 00000100:00100000:1.0:1788836203.344743:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836203.344753:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538474880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836203.344800:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836203.344843:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538474880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836203.344851:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788836203.344870:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788836203.344899:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb1880 x1875730538474880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836203.344930:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538474880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836203.345312:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538475136:0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836203.345384:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788836203.345389:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538475008:0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836203.345431:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538475520:0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836203.345480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475136 00000100:00100000:2.0:1788836203.345483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475136 00000100:00100000:2.0:1788836203.345509:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836203.345515:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538475136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345548:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538475136:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836203.345555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836203.345581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538475136:0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345610:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475520 00000100:00100000:2.0:1788836203.345614:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475520 00000100:00100000:2.0:1788836203.345654:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836203.345661:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538475520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836203.345696:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538475520:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836203.345709:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788836203.345736:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a422300 x1875730538475520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836203.345745:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538475520:0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.345882:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475008 00000100:00100000:1.0:1788836203.345886:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475008 00000100:00100000:1.0:1788836203.345918:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788836203.345925:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538475008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.345960:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538475008:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836203.345965:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788836203.345995:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538475008:0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346011:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538475264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836203.346054:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836203.346059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538475392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346079:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836203.346102:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475264 00000100:00100000:1.0:1788836203.346105:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475264 00000100:00100000:1.0:1788836203.346127:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475392 00000100:00100000:1.0:1788836203.346130:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475392 00000100:00100000:1.0:1788836203.346160:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836203.346166:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538475264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346200:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538475264:12345-0@lo:400:kworker.0 Request processed in 35us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836203.346206:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836203.346217:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836203.346224:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538475392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346249:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538475392:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836203.346254:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788836203.346275:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836203.346278:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836203.346306:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538475392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836203.346314:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538475264:0@lo:400:kworker.0 00000100:00100000:0.0:1788836203.856581:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836203.856602:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538475648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836203.856677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836203.859970:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475648 00000100:00100000:1.0:1788836203.859986:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475648 00000100:00100000:1.0:1788836203.860056:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836203.860066:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538475648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836203.860105:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836203.860190:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538475648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836203.860197:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788836203.860370:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb0000 x1875730538475648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836203.860390:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538475648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836204.312416:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836205.334630:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836206.356081:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836206.796067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836206.796208:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518520960 00000100:00100000:2.0:1788836206.796217:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518520960 00000100:00100000:2.0:1788836206.796281:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:2.0:1788836206.796291:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518520960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836206.796672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518520960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 380us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836206.796680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:3.0:1788836206.796697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836206.796828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836206.796862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836206.797209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836206.797280:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521216 00000100:00100000:2.0:1788836206.797286:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521216 00000100:00100000:2.0:1788836206.797326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521088 00000100:00100000:2.0:1788836206.797329:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521088 00000100:00100000:2.0:1788836206.797370:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788836206.797378:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518521216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836206.797470:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788836206.797480:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518521088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836206.806994:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518521216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 9606us (10288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836206.807008:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788836206.807180:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521344 00000100:00100000:2.0:1788836206.807189:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521344 00000100:00100000:2.0:1788836206.807228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521472 00000100:00100000:2.0:1788836206.807231:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521472 00000100:00100000:2.0:1788836206.807275:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836206.807283:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2352:x1875730518521344:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1788836206.807311:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9093c3 00000100:00080000:2.0:1788836206.807318:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bcf45115800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836206.807375:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788836206.807452:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518521088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 9972us (10622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836206.807467:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00080000:1.0:1788836206.807490:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836206.807493:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836206.807496:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836206.809734:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+2:2352:x1875730518521344:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 2443us (12862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836206.809748:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836206.809776:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836206.809787:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2352:x1875730518521472:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1788836206.809811:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9093ca 00000100:00080000:2.0:1788836206.809820:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bcf45116800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836206.809857:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788836206.810054:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+2:2352:x1875730518521472:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 269us (12845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836206.810061:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:2.0:1788836206.810094:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836206.810300:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836207.383330:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836208.402196:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836208.466670:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836208.466698:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538475776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836208.466763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836208.466839:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475776 00000100:00100000:0.0:1788836208.466856:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475776 00000100:00100000:0.0:1788836208.466910:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836208.466931:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538475776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836208.466964:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836208.467008:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538475776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836208.467022:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788836208.467042:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836208.467071:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb1500 x1875730538475776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836208.467089:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538475776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836208.468285:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538476032:0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.468328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836208.468379:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836208.468385:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538476160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.468406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836208.468434:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476032 00000100:00100000:0.0:1788836208.468440:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476032 00000100:00100000:0.0:1788836208.468473:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476160 00000100:00100000:0.0:1788836208.468476:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476160 00000100:00100000:0.0:1788836208.468503:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788836208.468510:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.468550:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538476032:12345-0@lo:400:kworker.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836208.468557:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788836208.468585:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788836208.468592:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538476160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.468618:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538476160:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836208.468717:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538476288:0@lo:400:kworker.0 00000100:00100000:3.0:1788836208.468745:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836208.468766:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788836208.468772:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538475904:0@lo:400:kworker.0 00000100:00100000:3.0:1788836208.468799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836208.468818:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538476416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836208.468839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836208.468979:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476288 00000100:00100000:2.0:1788836208.468983:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476288 00000100:00100000:2.0:1788836208.469015:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836208.469152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538476288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836208.469200:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538476288:12345-0@lo:400:kworker.0 Request processed in 179us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836208.469207:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836208.469226:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538475904 00000100:00100000:2.0:1788836208.469238:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538475904 00000100:00100000:2.0:1788836208.469274:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788836208.469280:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538475904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836208.469310:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538475904:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836208.469316:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788836208.469363:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476416 00000100:00100000:2.0:1788836208.469367:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476416 00000100:00100000:2.0:1788836208.469393:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836208.469399:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538476416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836208.469429:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538476416:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836208.469435:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836208.469522:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538475904:0@lo:400:kworker.0 00010000:00080000:3.0:1788836208.469536:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b17aa00 x1875730538476416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836208.469548:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538476416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836208.469557:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538476288:0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.470732:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788836208.470777:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836208.470791:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836208.470827:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538476160:0@lo:400:kworker.0 00000100:00100000:0.0:1788836208.470841:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538476032:0@lo:400:kworker.0 00000100:00100000:2.0:1788836208.977689:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538476544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836208.977773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836208.978104:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476544 00000100:00100000:0.0:1788836208.978112:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476544 00000100:00100000:0.0:1788836208.978456:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788836208.978469:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538476544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836208.978506:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836208.978564:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538476544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (803us total) trans 0 rc 0/0 00010000:00080000:2.0:1788836208.978612:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb3100 x1875730538476544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836208.978632:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538476544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836208.978639:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788836209.429580:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836210.224938:0:11003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788836210.451389:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836211.092970:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000020:00000080:3.0:1788836211.092980:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bcf45110000/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000020:00000080:2.0:1788836211.094194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45110000/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 for lustre-OST0000 00000020:00000080:2.0:1788836211.094253:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45115800 for lustre-OST0000 00000001:00100000:1.0:1788836211.105913:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000020:00000080:1.0:1788836211.105923:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bcf45114000/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000020:00000080:2.0:1788836211.106057:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45114000/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 for lustre-OST0001 00000020:00000080:2.0:1788836211.106119:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45116800 for lustre-OST0001 00010000:00010000:3.0:1788836211.472723:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836211.917476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836211.917532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836211.917563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836211.917598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521856 00000100:00100000:2.0:1788836211.917612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521856 00000100:00100000:2.0:1788836211.917663:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521728 00000100:00100000:2.0:1788836211.917667:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521728 00000100:00100000:1.0:1788836211.917677:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521600 00000100:00100000:1.0:1788836211.917681:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521600 00000100:00100000:2.0:1788836211.917690:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1788836211.917698:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2353:x1875730518521856:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836211.917709:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:1.0:1788836211.917715:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518521600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836211.917975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2353:x1875730518521856:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 275us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836211.917993:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1788836211.918014:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788836211.918021:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518521728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836211.922398:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518521600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4452us (4701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836211.922414:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1788836211.926140:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518521728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 8108us (8565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836211.926154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00080000:2.0:1788836211.926201:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836212.496595:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836213.524308:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836213.589007:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538476800:0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836213.589118:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538477312:0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589158:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836213.589187:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836213.589193:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538476928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836213.589253:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476800 00000100:00100000:3.0:1788836213.589260:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476800 00000100:00100000:3.0:1788836213.589293:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476928 00000100:00100000:3.0:1788836213.589295:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476928 00000100:00100000:3.0:1788836213.589319:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788836213.589326:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538476800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589390:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538476800:12345-0@lo:400:kworker.0 Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.589397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788836213.589413:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788836213.589419:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538476928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589441:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538476928:12345-0@lo:400:kworker.0 Request processed in 22us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.589446:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788836213.589463:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477312 00000100:00100000:3.0:1788836213.589466:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477312 00000100:00100000:3.0:1788836213.589491:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836213.589497:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538477312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589525:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538477312:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.589530:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788836213.589551:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836213.589555:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836213.589596:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538476928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.589606:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538476800:0@lo:400:kworker.0 00010000:00080000:3.0:1788836213.589617:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07af0f100 x1875730538477312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836213.589626:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788836213.589696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538476672:0@lo:400:kworker.0 00000100:00100000:0.0:1788836213.589726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.589757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538477184:0@lo:400:kworker.0 00000100:00100000:0.0:1788836213.589777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.589791:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836213.589797:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538477056:0@lo:400:kworker.0 00000100:00100000:0.0:1788836213.589819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.589844:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477056 00000100:00100000:0.0:1788836213.589847:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477056 00000100:00100000:0.0:1788836213.589872:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788836213.589878:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538477056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836213.589913:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538477056:12345-0@lo:400:kworker.0 Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836213.589919:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788836213.590069:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07af0c000 x1875730538477056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836213.590085:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538477056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.590138:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538476672 00000100:00100000:3.0:1788836213.590142:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538476672 00000100:00100000:3.0:1788836213.590175:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788836213.590181:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.590228:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538476672:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.590234:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788836213.590260:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538476672:0@lo:400:kworker.0 00000100:00080000:3.0:1788836213.590272:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836213.590281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477184 00000100:00100000:3.0:1788836213.590283:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477184 00000100:00100000:3.0:1788836213.590305:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788836213.590310:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538477184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836213.590338:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538477184:12345-0@lo:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.590362:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788836213.590384:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538477184:0@lo:400:kworker.0 00000100:00080000:3.0:1788836213.590395:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836213.594814:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538477440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836213.594885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.597153:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477440 00000100:00100000:0.0:1788836213.597166:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477440 00000100:00100000:0.0:1788836213.597307:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836213.597317:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538477440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836213.597371:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836213.597438:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538477440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836213.597446:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788836213.598149:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b179880 x1875730538477440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836213.598170:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538477440:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788836213.799671:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde42394c0 20000000:00000080:1.0:1788836213.799690:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd07ac7f000 uarg=0000000000000000 20000000:01000000:1.0:1788836213.799725:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836213.799730:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836213.799735:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788836213.802472:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788836213.802668:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788836213.812755:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836213.812787:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812809:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812818:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812824:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812847:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812854:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812874:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812916:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.812933:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 12 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836213.812947:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a420e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477568:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836213.813071:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.813080:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 18 pid: 5823 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836213.813090:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a420a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477696:0@lo:104: 00000100:00100000:2.0:1788836213.813130:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836213.813164:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.813173:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 18 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836213.813190:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a423100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477824:0@lo:104: 00000100:00100000:2.0:1788836213.813214:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836213.813258:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477696 00000100:00100000:2.0:1788836213.813265:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477696 00000100:00100000:2.0:1788836213.813303:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477824 00000100:00100000:2.0:1788836213.813307:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477824 00000100:00100000:2.0:1788836213.813322:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836213.813330:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11153:x1875730538477696:12345-0@lo:104: 00000100:00100000:1.0:1788836213.818962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836213.819610:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518521984 00000100:00100000:3.0:1788836213.819622:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518521984 00010000:00010000:3.0:1788836213.819670:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 13 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836213.819704:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788836213.819712:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047943850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518521984:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836213.819725:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836213.819730:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 13 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.819742:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 13 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.819760:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836213.819810:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047943850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518521984:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 98us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.819816:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00010000:00010000:0.0:1788836213.820846:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.820859:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836213.820873:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477952:0@lo:104: 00000100:00100000:0.0:1788836213.820920:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836213.820964:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.820975:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836213.821009:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b179180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538478080:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836213.821049:0:11153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70840 going to sleep for 11 seconds 00010000:00010000:0.0:1788836213.821072:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b9093b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a678 expref: 12 pid: 5822 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836213.821085:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a420e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477568:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836213.822728:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788836213.822739:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788836213.824519:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538477952 00000100:00100000:0.0:1788836213.824534:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538477952 00000100:00100000:1.0:1788836213.824675:0:11155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836213.824686:0:11155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:11153:x1875730538477824:12345-0@lo:104: 00010000:00010000:1.0:1788836213.824715:0:11155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.824814:0:11155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836213.824821:0:11155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+5:11153:x1875730538477824:12345-0@lo:104: Request processed in 138us (11606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836213.824828:0:11155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836213.824845:0:11155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836213.824852:0:11155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11153:x1875730538477952:12345-0@lo:104: 00010000:00010000:1.0:1788836213.824858:0:11155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.824893:0:11155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836213.824899:0:11155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11153:x1875730538477952:12345-0@lo:104: Request processed in 49us (3979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836213.824904:0:11155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788836213.824918:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836213.824923:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.824930:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836213.824934:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.824942:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836213.824949:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836213.824960:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836213.825006:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825012:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836213.825035:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825041:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90938b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909392 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825052:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836213.825055:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825060:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836213.825064:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825071:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836213.825077:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836213.825083:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836213.825094:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825099:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836213.825111:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825118:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060376e00/0xcb5b7bc40b90937d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b909384 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836213.825126:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836213.825128:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836213.825130:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836213.825251:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a423100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477824:0@lo:104: 00000100:00100000:0.0:1788836213.825261:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477952:0@lo:104: 00000100:00100000:0.0:1788836213.825404:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538478208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836213.825441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.825478:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836213.825483:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538478336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836213.825502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836213.825525:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478208 00000100:00100000:0.0:1788836213.825529:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478208 00010000:00010000:0.0:1788836213.825548:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 19 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836213.825566:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478336 00000100:00100000:0.0:1788836213.825569:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478336 00010000:00010000:0.0:1788836213.825579:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 20 pid: 5822 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836213.825592:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836213.825598:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+20:3304:x1875730538478208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836213.825614:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836213.825620:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 20 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825630:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 20 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825644:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b909392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90938b expref: 20 pid: 5824 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825655:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836213.825683:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538478208:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836213.825690:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836213.825703:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836213.825708:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3304:x1875730538478336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836213.825716:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836213.825720:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825728:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825737:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b909384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90937d expref: 18 pid: 5822 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.825744:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836213.825764:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3304:x1875730538478336:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836213.825778:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836213.825808:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538478336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836213.825815:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538478208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836213.825886:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836213.826653:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b179180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538478080:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836213.827844:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836213.827944:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836213.827952:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:11153:x1875730538477696:12345-0@lo:104: Request processed in 14620us (14820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836213.827961:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788836213.828145:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a420a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875730538477696:0@lo:104: 00010000:00010000:1.0:1788836213.828177:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.828744:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836213.828752:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.828761:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836213.828765:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.828775:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836213.828786:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836213.828805:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836213.828845:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.828852:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788836213.829107:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788836213.829246:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.829254:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998000/0xcb5b7bc40b909399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093a0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.829271:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836213.829273:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836213.829274:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836213.829439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836213.829513:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522112 00000100:00100000:3.0:1788836213.829522:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522112 00010000:00010000:3.0:1788836213.829549:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836213.829578:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788836213.829586:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+12:2354:x1875730518522112:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836213.829598:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836213.829603:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.829613:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.829627:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b909376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a640 expref: 12 pid: 5823 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.829647:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836213.829689:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+11:2354:x1875730518522112:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 104us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.829697:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788836213.830820:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538478464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836213.830922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836213.831161:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478464 00000100:00100000:3.0:1788836213.831168:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478464 00010000:00010000:3.0:1788836213.831191:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 17 pid: 5823 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836213.831260:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836213.831268:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3303:x1875730538478464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836213.831279:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836213.831284:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 17 pid: 5823 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831295:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 17 pid: 5823 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831309:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376800/0xcb5b7bc40b9093a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b909399 expref: 17 pid: 5823 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831323:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831331:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831372:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831386:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831393:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831400:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831406:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836213.831410:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831417:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831434:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836213.831444:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836213.831489:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3303:x1875730538478464:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836213.831496:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836213.831577:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538478464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836213.831718:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.831726:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836213.831732:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b9093d1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836214.109020:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538478592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836214.109088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836214.109338:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478592 00000100:00100000:0.0:1788836214.109362:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478592 00000100:00100000:0.0:1788836214.109418:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788836214.109427:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538478592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836214.109464:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836214.109528:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538478592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836214.109535:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788836214.109787:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb0700 x1875730538478592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836214.109814:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538478592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836214.544479:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788836215.376443:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836215.376450:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd079eb5000 from 7 10000000:01000000:1.0:1788836215.376456:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836215.376510:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.376522:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.376533:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836215.376557:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.376628:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.376677:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0431789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836215.376824:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478720 00000100:00100000:3.0:1788836215.376832:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478720 00000100:00100000:3.0:1788836215.376884:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788836215.377600:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538478720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836215.377617:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836215.377635:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9093d8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836215.377667:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836215.377677:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836215.377686:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836215.377732:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538478720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 839us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836215.377738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788836215.377833:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836215.377848:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.377856:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836215.378035:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.378065:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.378131:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0431789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.383290:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478848 00000100:00100000:0.0:1788836215.383302:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478848 00000100:00100000:0.0:1788836215.383398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788836215.383406:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538478848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.383671:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538478848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (5604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.383679:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788836215.383717:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.383758:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.383795:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836215.383819:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.383830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538478976 00000100:00100000:0.0:1788836215.383834:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538478976 00000100:00100000:0.0:1788836215.383848:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788836215.383853:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538478976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.384152:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538478976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 298us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.384159:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788836215.384204:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538478976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836215.386663:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788836215.386737:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788836215.386760:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836215.386771:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.386782:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836215.386810:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836215.386812:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd078fee000 from 7 10000000:01000000:0.0:1788836215.386815:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836215.386850:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.386858:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.386869:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836215.386891:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.388039:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836215.388080:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.388103:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479104 00000100:00100000:0.0:1788836215.388110:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479104 00000100:00100000:0.0:1788836215.388150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788836215.388158:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538479104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836215.388637:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836215.388655:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9093e6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.388680:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.388691:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.388717:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:0.0:1788836215.388761:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 604us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.388768:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788836215.388835:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836215.388851:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.388860:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836215.388930:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.388956:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836215.388988:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.389077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479232 00000100:00100000:0.0:1788836215.389081:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479232 00000100:00100000:0.0:1788836215.389107:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788836215.389114:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.389379:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.389386:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788836215.389419:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.389446:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.389482:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.389888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479360 00000100:00100000:1.0:1788836215.389904:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479360 00000100:00100000:1.0:1788836215.389941:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788836215.389948:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.390104:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836215.392149:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2194us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836215.392161:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788836215.392548:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b17a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836215.393526:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788836215.394127:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788836215.394146:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836215.394157:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.394181:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836215.394215:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836215.394218:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd0497a5800 from 7 10000000:01000000:1.0:1788836215.394221:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836215.394255:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.394263:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.394272:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836215.394294:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.394373:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.394409:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.394522:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479488 00000100:00100000:0.0:1788836215.394529:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479488 00000100:00100000:0.0:1788836215.394577:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788836215.394586:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538479488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836215.394599:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836215.394612:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b9093f4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.394634:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.394644:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836215.394652:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031c00, rc 0) 00000100:00100000:0.0:1788836215.394687:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538479488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.394693:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788836215.394821:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836215.394833:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.394842:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836215.394889:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.394927:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.394948:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.395089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479616 00000100:00100000:0.0:1788836215.395094:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479616 00000100:00100000:0.0:1788836215.395124:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788836215.395132:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538479616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.395662:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538479616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.395670:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788836215.395741:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.395771:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.395815:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836215.395836:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043178f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836215.395874:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479744 00000100:00100000:0.0:1788836215.395879:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479744 00000100:00100000:0.0:1788836215.396135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788836215.396146:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538479744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.396438:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538479744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.396445:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788836215.396624:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538479744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836215.398111:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788836215.402043:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788836215.402072:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836215.402083:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836215.402095:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836215.429041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836215.434249:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522240 00000100:00100000:0.0:1788836215.434265:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522240 00000100:00100000:1.0:1788836215.434635:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:1.0:1788836215.434647:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+11:5592:x1875730518522240:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836215.434664:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836215.434682:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6a2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.434710:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.434721:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.434729:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377000, rc 0) 00000100:00100000:1.0:1788836215.434796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522240:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 151us (5765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836215.434803:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:3.0:1788836215.439553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836215.448981:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522368 00000100:00100000:0.0:1788836215.448995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522368 00000100:00100000:0.0:1788836215.449054:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:0.0:1788836215.449065:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522368:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.449391:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522368:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 325us (9844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.449398:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:0.0:1788836215.453335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836215.453378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522496 00000100:00100000:0.0:1788836215.453387:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522496 00000100:00100000:0.0:1788836215.453421:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:0.0:1788836215.453429:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522496:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.453609:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522496:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 180us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.453617:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:0.0:1788836215.463944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836215.464221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522624 00000100:00100000:1.0:1788836215.464231:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522624 00000100:00100000:1.0:1788836215.464284:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:1.0:1788836215.464294:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518522624:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836215.464311:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836215.464329:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6a9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.464396:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.464408:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836215.464418:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376000, rc 0) 00000100:00100000:1.0:1788836215.464469:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518522624:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 176us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836215.464476:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:3.0:1788836215.477851:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836215.478012:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522752 00000100:00100000:1.0:1788836215.478023:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522752 00000100:00100000:1.0:1788836215.478120:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:1.0:1788836215.478131:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518522752:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836215.481095:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518522752:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 2957us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836215.481107:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:3.0:1788836215.486333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836215.489781:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518522880 00000100:00100000:0.0:1788836215.489804:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518522880 00000100:00100000:0.0:1788836215.491726:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:0.0:1788836215.491738:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518522880:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836215.491983:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518522880:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 246us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836215.491991:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00010000:00010000:3.0:1788836215.569081:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836216.592717:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836217.049402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836217.049438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836217.049471:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836217.049516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523264 00000100:00100000:0.0:1788836217.049526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523264 00000100:00100000:0.0:1788836217.049580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523136 00000100:00100000:0.0:1788836217.049583:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523136 00000100:00100000:0.0:1788836217.049608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788836217.049617:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518523264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836217.049688:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518523264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836217.049695:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788836217.049713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788836217.049719:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518523136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836217.049743:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518523136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836217.049750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00080000:0.0:1788836217.049768:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836217.049952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523008 00000100:00100000:2.0:1788836217.049957:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523008 00000100:00100000:2.0:1788836217.049999:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:2.0:1788836217.050006:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518523008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836217.050034:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518523008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836217.050058:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00010000:00010000:1.0:1788836217.616537:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836218.447662:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836218.642262:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836218.704835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836218.704919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.705653:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538480128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.705694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.705717:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836218.705723:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.705744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.705773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480128 00000100:00100000:3.0:1788836218.705780:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480128 00000100:00100000:3.0:1788836218.705813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480256 00000100:00100000:3.0:1788836218.705816:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480256 00000100:00100000:3.0:1788836218.705844:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836218.705853:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538480128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.705917:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538480128:12345-0@lo:400:kworker.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836218.705924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836218.705939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788836218.705952:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.705978:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538480256:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836218.705984:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788836218.706006:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836218.706035:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706045:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538480128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706227:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538480384:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.706268:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788836218.706273:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538480000:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.706326:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538480512:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836218.706385:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480000 00000100:00100000:3.0:1788836218.706388:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480000 00000100:00100000:3.0:1788836218.706414:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788836218.706419:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706447:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538480000:12345-0@lo:400:kworker.0 Request processed in 28us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836218.706453:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788836218.706475:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480512 00000100:00100000:3.0:1788836218.706477:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480512 00000100:00100000:3.0:1788836218.706500:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836218.706505:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538480512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706530:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538480512:12345-0@lo:400:kworker.0 Request processed in 25us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836218.706536:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788836218.706552:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836218.706558:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480384 00000100:00100000:3.0:1788836218.706560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480384 00000100:00100000:3.0:1788836218.706581:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788836218.706587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538480384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706612:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538480384:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836218.706617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788836218.706630:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836218.706642:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538480000:0@lo:400:kworker.0 00010000:00080000:3.0:1788836218.706662:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07af0fb80 x1875730538480512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836218.706672:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538480512:0@lo:400:kworker.0 00000100:00100000:3.0:1788836218.706680:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538480384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836218.708235:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538479872 00000100:00100000:0.0:1788836218.708245:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538479872 00000100:00100000:0.0:1788836218.708300:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788836218.708308:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538479872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836218.708339:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836218.708411:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538479872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836218.708417:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788836218.708435:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836218.708464:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07b179880 x1875730538479872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836218.708482:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538479872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836219.217203:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538480640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836219.217271:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836219.217432:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480640 00000100:00100000:2.0:1788836219.217440:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480640 00000100:00100000:2.0:1788836219.217489:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836219.217499:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538480640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836219.217535:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836219.217588:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538480640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836219.217596:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788836219.217675:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07acb2300 x1875730538480640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836219.217693:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538480640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836219.665407:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836220.689508:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836221.712621:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836222.152804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836222.152853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836222.153093:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523392 00000100:00100000:1.0:1788836222.153103:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523392 00000100:00100000:1.0:1788836222.153161:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:1.0:1788836222.153183:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518523392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836222.153271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518523392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 90us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836222.153278:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:2.0:1788836222.153734:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523648 00000100:00100000:2.0:1788836222.153741:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523648 00000100:00100000:2.0:1788836222.153787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:2.0:1788836222.153795:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518523648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836222.153834:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518523648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836222.153841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00080000:2.0:1788836222.153872:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836222.166798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836222.176472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523520 00000100:00100000:1.0:1788836222.176485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523520 00000100:00100000:1.0:1788836222.176571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1788836222.176582:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518523520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836222.176674:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518523520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 95us (10045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836222.176682:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00080000:2.0:1788836222.177068:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788836222.727383:0:11452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:56:59 (1788836219) === 00010000:00010000:3.0:1788836222.749671:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836223.106898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836223.106996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523776 00000100:00100000:2.0:1788836223.107006:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523776 00000100:00100000:2.0:1788836223.107066:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836223.107076:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518523776:12345-192.168.203.52@tcp:41:mkdir.0 00000004:00000024:2.0:1788836223.107115:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836223.107213:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518523776:12345-192.168.203.52@tcp:41:mkdir.0 Request processed in 138us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.107220:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788836223.108725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.108819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518523904 00000100:00100000:3.0:1788836223.108827:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518523904 00000100:00100000:3.0:1788836223.108888:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788836223.108897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:539937c3-f568-41e1-b7b5-fe9413243b52+6:9703:x1875730518523904:12345-192.168.203.52@tcp:700:mkdir.0 00000100:00100000:3.0:1788836223.108972:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:539937c3-f568-41e1-b7b5-fe9413243b52+6:9703:x1875730518523904:12345-192.168.203.52@tcp:700:mkdir.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.108980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836223.111878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.112018:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518524160 00000100:00100000:1.0:1788836223.112027:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518524160 00000100:00100000:1.0:1788836223.112085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788836223.112095:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:9703:x1875730518524160:12345-192.168.203.52@tcp:36:mkdir.0 00010000:00010000:1.0:1788836223.112148:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836223.112227:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b9092f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a62b expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112249:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836223.112260:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836223.112646:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112659:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112677:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112710:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112717:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.112724:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836223.113805:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788836223.113818:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113827:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113835:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113841:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836223.113845:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113851:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113864:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd07a955000) 00010000:00010000:1.0:1788836223.113866:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836223.113875:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.113882:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909410 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836223.113898:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b589fa4f reply state 00000000ab3a12e5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836223.113907:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836223.113990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:9703:x1875730518524160:12345-192.168.203.52@tcp:36:mkdir.0 Request processed in 1893us (2129us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788836223.113998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:2.0:1788836223.117183:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117202:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117210:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117216:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.117222:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117230:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117250:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd07a955c00) 00010000:00010000:2.0:1788836223.117253:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836223.117258:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.117266:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b909417 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836223.130801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836223.131403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518524288 00000100:00100000:2.0:1788836223.131413:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518524288 00000100:00100000:2.0:1788836223.131469:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788836223.131478:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:9704:x1875730518524288:12345-192.168.203.52@tcp:101:chmod.0 00010000:00010000:2.0:1788836223.131500:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836223.131522:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90941e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131604:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131617:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131627:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836223.131659:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836223.131662:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836223.131712:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131739:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90941e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b0 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131756:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b0 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.131764:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940ba00) 00010000:00010000:2.0:1788836223.131767:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836223.131769:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999e00, rc 0) 00000100:00100000:2.0:1788836223.131837:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:9704:x1875730518524288:12345-192.168.203.52@tcp:101:chmod.0 Request processed in 359us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.131844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788836223.135502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.135582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518524544 00000100:00100000:1.0:1788836223.135591:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518524544 00000100:00100000:1.0:1788836223.135647:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788836223.135656:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:9704:x1875730518524544:12345-192.168.203.52@tcp:36:chmod.0 00010000:00010000:1.0:1788836223.135706:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836223.135730:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b0 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.135745:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940ba00) 00010000:00010000:1.0:1788836223.135755:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836223.135778:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.135789:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.135797:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836223.136261:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd4c47e5 reply state 000000002bd4e9fd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836223.136272:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788836223.136279:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788836223.136584:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:9704:x1875730518524544:12345-192.168.203.52@tcp:36:chmod.0 Request processed in 928us (1089us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788836223.136592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00010000:00010000:0.0:1788836223.146829:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.146847:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.146854:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.146908:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.146976:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.146985:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.147019:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd07a955000) 00010000:00010000:0.0:1788836223.147023:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836223.147027:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.147034:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90942c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836223.159313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.159430:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518524672 00000100:00100000:3.0:1788836223.159440:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518524672 00000100:00100000:3.0:1788836223.159514:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788836223.159523:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:9705:x1875730518524672:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:3.0:1788836223.159548:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836223.159572:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6b7 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159634:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159647:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159660:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836223.159693:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788836223.159697:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836223.159732:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159757:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b7 expref: 9 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159775:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b7 expref: 8 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.159782:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2400) 00010000:00010000:3.0:1788836223.159785:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836223.159788:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d000, rc 0) 00000100:00100000:3.0:1788836223.159851:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+8:9705:x1875730518524672:12345-192.168.203.52@tcp:101:chown.0 Request processed in 329us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.159878:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788836223.162964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836223.163093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518524800 00000100:00100000:0.0:1788836223.163102:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518524800 00000100:00100000:0.0:1788836223.163166:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836223.163176:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+8:9705:x1875730518524800:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:0.0:1788836223.163195:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836223.163213:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b909441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163272:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163286:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163297:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163323:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163331:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163388:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163483:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163492:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163499:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836223.163526:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836223.163530:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836223.163548:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163560:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163567:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163574:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163579:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.163583:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163590:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163610:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2400) 00010000:00010000:0.0:1788836223.163613:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.163618:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163625:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163639:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163646:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163652:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163656:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.163659:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163665:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163672:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836223.163675:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.163678:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163683:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90944f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163725:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b909441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6be expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163738:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6be expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.163745:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:0.0:1788836223.163748:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836223.163750:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030e00, rc 0) 00000100:00100000:0.0:1788836223.163806:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:9705:x1875730518524800:12345-192.168.203.52@tcp:101:chown.0 Request processed in 632us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836223.163813:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836223.167695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.167770:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525056 00000100:00100000:3.0:1788836223.167780:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525056 00000100:00100000:3.0:1788836223.167838:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836223.167849:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+9:9705:x1875730518525056:12345-192.168.203.52@tcp:36:chown.0 00010000:00010000:3.0:1788836223.167911:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836223.167949:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030e00/0xcb5b7bc40b909456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6be expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.167970:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:3.0:1788836223.167979:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836223.168006:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.168017:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.168027:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836223.201085:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c726392 reply state 00000000761862c3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836223.201122:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836223.201137:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788836223.201250:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+10:9705:x1875730518525056:12345-192.168.203.52@tcp:36:chown.0 Request processed in 33398us (33561us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788836223.201259:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000001:00080000:0.0:1788836223.205330:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1788836223.205397:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788836223.205422:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.205432:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.205439:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.205443:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.205970:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.206000:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.206017:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0452e2e00) 00010000:00010000:0.0:1788836223.206020:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836223.206025:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.206031:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90945d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836223.217533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.217721:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525184 00000100:00100000:3.0:1788836223.217731:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525184 00000100:00100000:3.0:1788836223.217787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788836223.217797:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:9707:x1875730518525184:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:3.0:1788836223.217820:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836223.217839:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6c5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836223.219994:0:5830:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2089us 00010000:00010000:0.0:1788836223.229570:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229592:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229604:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229620:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229627:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229633:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229976:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229991:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.229998:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836223.230020:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836223.230024:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836223.230056:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230067:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230072:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230078:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230084:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.230088:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230094:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230106:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2400) 00010000:00010000:0.0:1788836223.230108:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.230113:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230127:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90946b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230140:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230146:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230152:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230171:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.230174:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230180:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230188:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836223.230190:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.230193:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230198:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b909472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230233:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6c5 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230247:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6c5 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.230260:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:0.0:1788836223.230262:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788836223.230264:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031600, rc 0) 00000100:00100000:0.0:1788836223.230336:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:9707:x1875730518525184:12345-192.168.203.52@tcp:101:touch.500 Request processed in 12539us (12811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836223.230371:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788836223.240626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.240895:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525440 00000100:00100000:3.0:1788836223.240906:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525440 00000100:00100000:3.0:1788836223.241621:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788836223.241635:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:9707:x1875730518525440:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:3.0:1788836223.241656:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836223.241675:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909480 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.241960:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.241973:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.241984:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.242866:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.242880:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.242888:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836223.244310:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788836223.245233:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909495 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245249:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245261:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909495 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245298:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245305:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245312:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245317:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836223.245321:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245328:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.245339:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:3.0:1788836223.246773:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836223.246782:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.246791:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909487 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836223.246829:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ebadc9e reply state 00000000d70c4db5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836223.246839:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836223.246888:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909480 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6cc expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.246902:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909495 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6cc expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.246910:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:3.0:1788836223.247272:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836223.247276:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0da00, rc 0) 00000100:00100000:3.0:1788836223.247580:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:9707:x1875730518525440:12345-192.168.203.52@tcp:101:touch.500 Request processed in 5948us (7028us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788836223.247589:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788836223.251721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.251807:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525696 00000100:00100000:1.0:1788836223.251817:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525696 00000100:00100000:1.0:1788836223.251878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788836223.251887:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+10:9707:x1875730518525696:12345-192.168.203.52@tcp:36:touch.500 00010000:00010000:1.0:1788836223.251940:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836223.251963:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909495 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6cc expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.251979:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:1.0:1788836223.251988:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836223.252040:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.252054:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.252064:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836223.252209:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092955d97 reply state 000000000d5189d0 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836223.252218:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836223.252307:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+11:9707:x1875730518525696:12345-192.168.203.52@tcp:36:touch.500 Request processed in 421us (594us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788836223.252315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:0.0:1788836223.253075:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253085:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253091:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253096:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.253100:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253107:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253119:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9bd0452e2a00) 00010000:00010000:0.0:1788836223.253121:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.253125:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.253131:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90948e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836223.254992:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.255286:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525824 00000100:00100000:3.0:1788836223.255295:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525824 00000100:00100000:3.0:1788836223.255374:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788836223.255384:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+10:9707:x1875730518525824:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:3.0:1788836223.255417:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836223.255437:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9094aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6d3 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.255492:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9094aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6d3 expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.255525:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9094aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6d3 expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.255543:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd07a955a00) 00010000:00010000:3.0:1788836223.255546:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836223.255559:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d400, rc 0) 00000100:00100000:3.0:1788836223.255607:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+11:9707:x1875730518525824:12345-192.168.203.52@tcp:101:touch.500 Request processed in 224us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.255613:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00010000:00010000:0.0:1788836223.256303:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256315:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256323:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256330:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836223.256334:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256366:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256381:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd07a955a00) 00010000:00010000:0.0:1788836223.256383:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836223.256387:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836223.256393:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836223.261200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.261379:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518525952 00000100:00100000:3.0:1788836223.261389:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518525952 00000100:00100000:3.0:1788836223.261452:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788836223.261546:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518525952:12345-192.168.203.52@tcp:8:touch.500 00010000:00080000:2.0:1788836223.261797:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1788836223.261831:0:6680:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b9094b1 00002000:00100000:2.0:1788836223.261843:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 539937c3-f568-41e1-b7b5-fe9413243b52/ffff9bd047f58000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836223.261866:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788836223.262099:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836223.262128:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bd047f5e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836223.262258:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518525952:12345-192.168.203.52@tcp:8:touch.500 Request processed in 713us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.262266:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788836223.268126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.268329:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518526080 00000100:00100000:3.0:1788836223.268339:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518526080 00000100:00100000:3.0:1788836223.268490:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836223.268500:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:0:x1875730518526080:12345-192.168.203.52@tcp:2:touch.500 00000100:00080000:2.0:1788836223.269753:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788836223.307317:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000001:00080000:3.0:1788836223.307336:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788836223.307784:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:0:x1875730518526080:12345-192.168.203.52@tcp:2:touch.500 Request processed in 39280us (39662us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788836223.307795:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788836223.312833:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.313088:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518526336 00000100:00100000:1.0:1788836223.313098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518526336 00000100:00100000:1.0:1788836223.313204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836223.313214:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+10:9707:x1875730518526336:12345-192.168.203.52@tcp:35:touch.500 00000100:00100000:1.0:1788836223.315801:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+11:9707:x1875730518526336:12345-192.168.203.52@tcp:35:touch.500 Request processed in 2577us (2966us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788836223.315815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788836223.339269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.339380:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518526464 00000100:00100000:1.0:1788836223.339390:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518526464 00000100:00100000:1.0:1788836223.339457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788836223.339467:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+11:9708:x1875730518526464:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1788836223.339492:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836223.339513:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6da expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.339576:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.339589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.339615:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836223.339837:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788836223.339841:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836223.339891:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.340096:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6da expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.340116:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6da expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.340124:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:1.0:1788836223.340127:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836223.340130:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376400, rc 0) 00000100:00100000:1.0:1788836223.340208:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+12:9708:x1875730518526464:12345-192.168.203.52@tcp:101:rm.0 Request processed in 742us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836223.340215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788836223.351628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.351828:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518526720 00000100:00100000:3.0:1788836223.351838:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518526720 00000100:00100000:3.0:1788836223.351924:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1788836223.351934:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+12:9708:x1875730518526720:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:3.0:1788836223.351955:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836223.351977:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b9094c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6e1 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836223.352422:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836223.352774:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b9094c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6e1 expref: 14 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.352789:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2400) 00010000:00010000:3.0:1788836223.352792:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836223.352797:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b9094c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6e1 expref: 14 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.352811:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0cc00, rc 0) 00000100:00100000:3.0:1788836223.353297:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:9708:x1875730518526720:12345-192.168.203.52@tcp:101:rm.0 Request processed in 1362us (1677us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788836223.353306:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788836223.368610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.368772:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518526848 00000100:00100000:1.0:1788836223.368782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518526848 00000100:00100000:1.0:1788836223.368838:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836223.368848:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:9708:x1875730518526848:12345-192.168.203.52@tcp:37:rm.0 00000100:00100000:0.0:1788836223.378369:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:9708:x1875730518526848:12345-192.168.203.52@tcp:37:rm.0 Request processed in 9495us (9741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836223.378387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836223.391094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836223.391299:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518527104 00000100:00100000:2.0:1788836223.391309:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518527104 00000100:00100000:2.0:1788836223.391520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836223.391535:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+13:9708:x1875730518527104:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:2.0:1788836223.391791:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:9708:x1875730518527104:12345-192.168.203.52@tcp:35:rm.0 Request processed in 260us (705us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788836223.392166:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836223.398943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.399185:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518527360 00000100:00100000:1.0:1788836223.399195:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518527360 00000100:00100000:1.0:1788836223.399268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788836223.399279:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:9708:x1875730518527360:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1788836223.399304:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836223.399321:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9094d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6e8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.399458:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.399473:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.399485:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836223.399495:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788836223.399607:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9094d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6e8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.399626:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6e8 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.399634:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:1.0:1788836223.399637:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836223.399640:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376800, rc 0) 00000100:00100000:1.0:1788836223.399700:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518527360:12345-192.168.203.52@tcp:101:rm.0 Request processed in 423us (765us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788836223.399707:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836223.403321:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836223.403538:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518527488 00000100:00100000:2.0:1788836223.403548:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518527488 00000100:00100000:2.0:1788836223.403602:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788836223.403612:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518527488:12345-192.168.203.52@tcp:41:rm.0 00000004:00000024:2.0:1788836223.403671:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788836223.403747:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518527488:12345-192.168.203.52@tcp:41:rm.0 Request processed in 137us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.403755:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788836223.407210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.407876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518527616 00000100:00100000:1.0:1788836223.407900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518527616 00000100:00100000:2.0:1788836223.408310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788836223.408320:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518527616:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1788836223.408359:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836223.408381:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9094e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6ef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408469:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408491:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408505:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408513:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408519:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408612:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408619:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408625:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836223.408652:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788836223.408657:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836223.408675:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408687:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408695:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408711:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408717:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408723:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.408727:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408734:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408746:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:2.0:1788836223.408750:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836223.408754:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408761:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9094f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408773:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408779:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408783:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408788:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.408797:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408803:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408811:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9bd04940b700) 00010000:00010000:2.0:1788836223.408814:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836223.408817:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408821:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b9094f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408851:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9094e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6ef expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408876:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6ef expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.408883:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd07a955a00) 00010000:00010000:2.0:1788836223.408885:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836223.408887:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999400, rc 0) 00000100:00100000:2.0:1788836223.408967:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+17:9708:x1875730518527616:12345-192.168.203.52@tcp:101:rm.0 Request processed in 648us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.408974:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788836223.412577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836223.412654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518527872 00000100:00100000:2.0:1788836223.412663:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518527872 00000100:00100000:2.0:1788836223.412750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788836223.412761:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+17:9708:x1875730518527872:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:2.0:1788836223.412828:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836223.412854:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b9094fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6ef expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412889:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9094aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6d3 expref: 16 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412899:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd07a955a00) 00010000:00010000:2.0:1788836223.412918:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9094bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6da expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412927:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:2.0:1788836223.412930:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836223.412948:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412959:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412969:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412981:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412988:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.412994:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.413417:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.413427:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.413435:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836223.414231:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788836223.414241:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 276548897270ns, next at 277548894920ns, rc = 0 00010000:00010000:2.0:1788836223.414296:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414306:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414315:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414323:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414330:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414336:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414381:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836223.414398:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414410:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414416:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414422:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.414427:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414434:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414773:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836223.414777:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788836223.414782:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414788:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909513 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414805:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414811:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414817:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414822:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.414831:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414837:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414845:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:2.0:1788836223.414847:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836223.414850:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.414856:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b909505 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836223.414864:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6b33f66 reply state 00000000af4f200d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836223.414873:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836223.415009:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518527872:12345-192.168.203.52@tcp:36:rm.0 Request processed in 2247us (2437us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788836223.415017:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00010000:00010000:1.0:1788836223.415037:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836223.415044:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.415050:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836223.415053:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.415059:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.415069:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:1.0:1788836223.415071:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788836223.415074:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.415080:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90951a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.415094:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836223.415096:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836223.415097:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836223.419794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836223.419946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528128 00000100:00100000:1.0:1788836223.419955:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528128 00000100:00100000:1.0:1788836223.420023:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836223.420033:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518528128:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:1.0:1788836223.420256:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+17:9708:x1875730518528128:12345-192.168.203.52@tcp:35:rm.0 Request processed in 224us (471us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788836223.420265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836223.423292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836223.423660:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528384 00000100:00100000:3.0:1788836223.423672:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528384 00000100:00100000:3.0:1788836223.423735:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1788836223.423746:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:9708:x1875730518528384:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788836223.423806:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788836223.423832:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9094db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6e8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423868:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909479 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6c5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423882:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0498ed000) 00010000:00010000:3.0:1788836223.423910:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90943a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6b7 expref: 15 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423919:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2400) 00010000:00010000:3.0:1788836223.423925:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836223.423949:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423960:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423971:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423983:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423990:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.423997:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.424769:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.424782:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.424790:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836223.425581:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836223.425606:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425615:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425622:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425629:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836223.425634:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425641:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425656:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd0452e2100) 00010000:00010000:3.0:1788836223.425659:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788836223.425663:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425668:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90952f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425690:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425697:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425703:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425708:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0cc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836223.425718:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425726:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425734:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0452e2800) 00010000:00010000:3.0:1788836223.425737:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836223.425739:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.425746:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0cc00/0xcb5b7bc40b909521 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836223.425758:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000861ca2b8 reply state 0000000075068996 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836223.425766:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836223.426277:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:9708:x1875730518528384:12345-192.168.203.52@tcp:36:rm.0 Request processed in 2527us (2989us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788836223.426286:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00010000:00010000:2.0:1788836223.426651:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426660:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426665:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426670:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836223.426673:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426691:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426702:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9bd04940b300) 00010000:00010000:2.0:1788836223.426704:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836223.426708:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836223.426713:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90950c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436642:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436672:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436679:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436686:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836223.436691:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436699:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436715:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd0452e2200) 00010000:00010000:1.0:1788836223.436718:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836223.436722:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836223.436728:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909528 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836223.764047:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836223.824588:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836223.824614:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538480768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836223.824682:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825304:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538480896:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825402:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538481408:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825448:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836223.825453:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538481024:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825522:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481408 00000100:00100000:3.0:1788836223.825530:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481408 00000100:00100000:3.0:1788836223.825579:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836223.825588:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538481408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825638:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538481408:12345-0@lo:400:kworker.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.825645:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836223.825668:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538481280:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825730:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836223.825736:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836223.825781:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481024 00000100:00100000:3.0:1788836223.825785:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481024 00000100:00100000:3.0:1788836223.825809:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481280 00000100:00100000:3.0:1788836223.825812:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481280 00000100:00100000:3.0:1788836223.825823:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481152 00000100:00100000:3.0:1788836223.825825:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481152 00000100:00100000:3.0:1788836223.825836:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836223.825841:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538481024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.825870:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538481024:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.825876:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788836223.825887:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836223.825893:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538481280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836223.826056:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480896 00000100:00100000:0.0:1788836223.826060:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480896 00000100:00100000:0.0:1788836223.826092:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788836223.826098:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836223.826132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538480896:12345-0@lo:400:kworker.0 Request processed in 35us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836223.826138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788836223.826184:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788836223.826191:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538481152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836223.826224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538481152:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836223.826230:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788836223.826282:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538481024:0@lo:400:kworker.0 00000100:00100000:0.0:1788836223.826292:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538480896:0@lo:400:kworker.0 00010000:00080000:0.0:1788836223.826303:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae58380 x1875730538481408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836223.826313:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538481408:0@lo:400:kworker.0 00000100:00100000:0.0:1788836223.826374:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538481152:0@lo:400:kworker.0 00000100:00100000:3.0:1788836223.826465:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538481280:12345-0@lo:400:kworker.0 Request processed in 571us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836223.826472:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788836223.827043:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538480768 00000100:00100000:2.0:1788836223.827048:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538480768 00000100:00100000:2.0:1788836223.827082:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836223.827090:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538480768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836223.827117:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836223.827172:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538480768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836223.827178:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788836223.827196:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836223.827200:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836223.827202:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836223.827825:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538481280:0@lo:400:kworker.0 00010000:00080000:3.0:1788836223.829198:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3c380 x1875730538480768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836223.829246:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538480768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836224.344308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538481536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836224.344399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836224.345604:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481536 00000100:00100000:0.0:1788836224.345616:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481536 00000100:00100000:0.0:1788836224.345707:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788836224.345717:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538481536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836224.345745:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836224.350819:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538481536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5092us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836224.350833:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788836224.351192:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a30d180 x1875730538481536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836224.351217:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538481536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836224.785751:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836225.817727:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836226.836510:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836227.269874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836227.269918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836227.269954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836227.269991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836227.270039:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528640 00000100:00100000:0.0:1788836227.270048:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528640 00000100:00100000:0.0:1788836227.270100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528896 00000100:00100000:0.0:1788836227.270104:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528896 00000100:00100000:0.0:1788836227.270126:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1788836227.270145:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:2356:x1875730518528640:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836227.270213:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:2356:x1875730518528640:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836227.270220:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1788836227.270235:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788836227.270240:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518528896:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836227.270258:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518528896:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 18us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836227.270264:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788836227.270582:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528768 00000100:00100000:3.0:1788836227.270587:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528768 00000100:00100000:3.0:1788836227.270631:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836227.270640:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518528768:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836227.270683:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518528768:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836227.270690:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788836227.274742:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518528512 00000100:00100000:2.0:1788836227.274757:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518528512 00000100:00100000:2.0:1788836227.274824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:2.0:1788836227.274834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518528512:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836227.274918:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518528512:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836227.274941:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00080000:2.0:1788836227.274977:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836227.274983:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836227.870936:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836228.306578:0:11602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788836228.551544:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1788836228.551566:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788836228.551581:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1788836228.554461:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538481664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836228.554537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836228.563797:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481664 00000100:00100000:2.0:1788836228.563810:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481664 00000100:00080000:2.0:1788836228.573841:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836228.575260:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836228.575275:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538481664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788836228.575308:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788836228.575362:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f797d, atime: 0x6a9f797d, ctime: 0x6a9f797d, blocks: 0x1 00010000:00010000:2.0:1788836228.575370:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836228.576129:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=281s v=(0 0) 00010000:00010000:2.0:1788836228.576134:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836228.576142:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836228.576161:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836228.576171:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836228.576180:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836228.576250:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836228.580405:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538481664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5128us (25861us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788836228.580419:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788836228.585854:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836228.585867:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836228.586054:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836228.586060:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836228.586072:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836228.586097:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836228.586105:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909536 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836228.586137:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836228.586139:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836228.586141:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788836228.586197:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07acb0e00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788836228.586206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538481664:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788836228.880511:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836228.944928:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538481792:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.945008:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945056:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.945079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945111:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836228.945117:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538482176:0@lo:400:kworker.0 00000100:00100000:0.0:1788836228.945133:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481792 00000100:00100000:0.0:1788836228.945148:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481792 00000100:00100000:3.0:1788836228.945156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945192:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538481920:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.945216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945243:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538482432:0@lo:400:kworker.0 00000100:00100000:0.0:1788836228.945245:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788836228.945261:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538481792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.945277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945295:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836228.945302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538482048:0@lo:400:kworker.0 00000100:00100000:0.0:1788836228.945385:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538481792:12345-0@lo:400:kworker.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836228.945393:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788836228.945534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836228.945578:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482304 00000100:00100000:3.0:1788836228.945584:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482304 00000100:00100000:0.0:1788836228.945627:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538481920 00000100:00100000:0.0:1788836228.945635:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538481920 00000100:00100000:3.0:1788836228.945647:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482048 00000100:00100000:3.0:1788836228.945652:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482048 00000100:00100000:0.0:1788836228.945672:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788836228.945682:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538482304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836228.945729:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538482304:12345-0@lo:400:kworker.0 Request processed in 50us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836228.946572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788836228.946586:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538481920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.946649:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538481920:12345-0@lo:400:kworker.0 Request processed in 67us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836228.946657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788836228.946674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788836228.946681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538482048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.946706:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538482048:12345-0@lo:400:kworker.0 Request processed in 26us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836228.946712:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788836228.946731:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482176 00000100:00100000:3.0:1788836228.946734:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482176 00000100:00100000:3.0:1788836228.946762:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482432 00000100:00100000:3.0:1788836228.946764:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482432 00000100:00100000:3.0:1788836228.946778:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836228.946783:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538482176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.946810:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538482176:12345-0@lo:400:kworker.0 Request processed in 28us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836228.946817:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836228.946843:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788836228.946848:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538482432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.946941:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538482432:12345-0@lo:400:kworker.0 Request processed in 91us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836228.946947:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788836228.946972:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836228.946977:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836228.947134:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538482048:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.947146:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538481920:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.947157:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538482432:0@lo:400:kworker.0 00010000:00080000:3.0:1788836228.947192:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd047eb5180 x1875730538482176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836228.947407:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.947513:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538481792:0@lo:400:kworker.0 00000100:00100000:3.0:1788836228.947529:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538482304:0@lo:400:kworker.0 00000100:00100000:0.0:1788836228.948446:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788836228.952979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538482560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836228.953257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836228.957498:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482560 00000100:00100000:0.0:1788836228.957516:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482560 00000100:00100000:0.0:1788836228.957591:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788836228.957601:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538482560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836228.957650:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836228.957740:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538482560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836228.957747:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788836228.958088:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae5bb80 x1875730538482560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836228.958114:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538482560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836229.459492:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836229.459525:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538482688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836229.459615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836229.459682:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538482688 00000100:00100000:0.0:1788836229.459691:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538482688 00000100:00100000:0.0:1788836229.459751:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836229.459761:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538482688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836229.459809:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836229.459866:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538482688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836229.459886:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836229.459985:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538482688:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788836229.619639:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeebffb5c0 20000000:00000080:2.0:1788836229.619660:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd07a3b6000 uarg=0000000000000000 20000000:01000000:2.0:1788836229.619700:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788836229.619708:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788836229.619713:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788836229.622749:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788836229.623856:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788836229.632514:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788836229.632564:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788836229.632643:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788836229.632661:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836229.632682:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632700:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632707:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632713:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632723:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632731:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632738:0:11652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632776:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632802:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 12 pid: 5824 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.632817:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538482816:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836229.632927:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632935:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.632943:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538482944:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836229.632973:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.632981:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 18 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.632988:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483072:0@lo:104: 00000100:00100000:0.0:1788836229.633018:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836229.633044:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.633051:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 18 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836229.633052:0:11155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483072 00000100:00100000:0.0:1788836229.633058:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483200:0@lo:104: 00000100:00100000:1.0:1788836229.633059:0:11155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483072 00000100:00100000:0.0:1788836229.633077:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836229.633111:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836229.633112:0:11155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483200 00000100:00100000:1.0:1788836229.633123:0:11155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483200 00010000:00010000:0.0:1788836229.633132:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 18 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836229.633138:0:11155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836229.633140:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483328:0@lo:104: 00000100:00100000:1.0:1788836229.633146:0:11155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11652:x1875730538483072:12345-0@lo:104: 00010000:00010000:1.0:1788836229.633158:0:11155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.633162:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836229.633170:0:11652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd04868fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1788836229.633205:0:11155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836229.633211:0:11155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11652:x1875730538483072:12345-0@lo:104: Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836229.633218:0:11155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836229.633222:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483072:0@lo:104: 00000100:00100000:1.0:1788836229.633236:0:11155:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788836229.633245:0:11155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483328 00000100:00100000:1.0:1788836229.633248:0:11155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483328 00000100:00100000:1.0:1788836229.633262:0:11155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836229.633267:0:11155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11652:x1875730538483200:12345-0@lo:104: 00010000:00010000:1.0:1788836229.633274:0:11155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633313:0:11155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788836229.633318:0:11155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+4:11652:x1875730538483200:12345-0@lo:104: Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836229.633324:0:11155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788836229.633336:0:11155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836229.633366:0:11155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:11652:x1875730538483328:12345-0@lo:104: 00010000:00010000:1.0:1788836229.633373:0:11155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633411:0:11155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788836229.633416:0:11155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+3:11652:x1875730538483328:12345-0@lo:104: Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836229.633421:0:11155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788836229.633453:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788836229.633459:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633466:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836229.633470:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633479:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836229.633486:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836229.633492:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836229.633516:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.633520:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483200:0@lo:104: 00010000:00010000:1.0:1788836229.633523:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788836229.633527:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538483328:0@lo:104: 00010000:00010000:1.0:1788836229.633541:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633548:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060376c00/0xcb5b7bc40b9093f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093fb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.633553:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836229.633564:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538483456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836229.633571:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836229.633575:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633592:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836229.633595:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633602:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836229.633609:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836229.633614:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836229.633627:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633633:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788836229.633633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788836229.633648:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633655:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030c00/0xcb5b7bc40b9093e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093ed expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633675:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836229.633679:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633698:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836229.633701:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633707:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836229.633712:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836229.633717:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836229.633730:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633735:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836229.633742:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633748:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060377c00/0xcb5b7bc40b9093d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b9093df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633761:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836229.633762:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836229.633764:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836229.633770:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836229.633775:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836229.633786:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538483584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836229.633809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836229.633835:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836229.633848:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538483712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836229.633862:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483456 00000100:00100000:0.0:1788836229.633867:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483456 00000100:00100000:1.0:1788836229.633871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836229.633884:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 19 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836229.633896:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483584 00000100:00100000:1.0:1788836229.633899:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483584 00000100:00100000:0.0:1788836229.633899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483712 00000100:00100000:0.0:1788836229.633901:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483712 00010000:00010000:1.0:1788836229.633910:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.633910:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836229.633924:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836229.633927:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836229.633929:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538483456:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836229.633932:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047942c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3304:x1875730538483712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836229.633939:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836229.633939:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836229.633944:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.633944:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.633952:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836229.634012:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836229.634020:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3304:x1875730538483584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836229.634035:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836229.634040:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.634105:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.634129:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b9093fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9093f4 expref: 21 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.634140:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0ca00/0xcb5b7bc40b9093df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9093d8 expref: 20 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.634141:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836229.634148:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836229.634171:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047942c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538483712:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836229.634171:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538483456:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836229.634178:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836229.634188:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836229.634214:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538483456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836229.634269:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538483712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836229.635260:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 17 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836229.635279:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030800/0xcb5b7bc40b9093ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b9093e6 expref: 17 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836229.635291:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836229.635366:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3304:x1875730538483584:12345-0@lo:103:ldlm_bl.0 Request processed in 1323us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836229.635373:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836229.635570:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538483584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836229.638498:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538482816:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836229.638512:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875730538482944:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836229.638544:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836229.639465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836229.639527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836229.639566:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529024 00000100:00100000:2.0:1788836229.639576:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529024 00000100:00100000:0.0:1788836229.639579:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529152 00000100:00100000:0.0:1788836229.639584:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529152 00010000:00010000:2.0:1788836229.639620:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 14 pid: 5824 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836229.639621:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 14 pid: 5822 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836229.639712:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788836229.639722:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+14:2353:x1875730518529024:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836229.639736:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836229.639742:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 14 pid: 5824 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639754:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 14 pid: 5824 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639786:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a9 expref: 14 pid: 5824 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639801:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836229.639867:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518529024:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 147us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836229.639879:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788836229.639897:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1788836229.639905:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+12:2353:x1875730518529152:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836229.639913:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836229.639918:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639929:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639940:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377000/0xcb5b7bc40b909402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6a2 expref: 12 pid: 5822 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639953:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639960:0:8494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639975:0:8494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639993:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.639999:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.640007:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.640013:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836229.640017:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.640026:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.640039:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836229.640050:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836229.640070:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836229.640080:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+11:2353:x1875730518529152:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 175us (550us total) trans 0 rc 0/0 00010000:00010000:0.0:1788836229.640083:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836229.640094:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00010000:00010000:0.0:1788836229.640096:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90953d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836229.904499:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836230.928589:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836231.046160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836231.046252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529280 00000100:00100000:3.0:1788836231.046263:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529280 00000100:00100000:3.0:1788836231.046321:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:3.0:1788836231.046332:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+11:5592:x1875730518529280:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836231.046374:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836231.046392:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0cc00/0xcb5b7bc40b909544 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6f6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836231.046421:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0cc00/0xcb5b7bc40b909544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6f6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836231.046432:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0cc00/0xcb5b7bc40b909544 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6f6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836231.046441:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0cc00, rc 0) 00000100:00100000:3.0:1788836231.046512:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529280:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 182us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.046520:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:2.0:1788836231.052988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.057322:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529408 00000100:00100000:0.0:1788836231.057336:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529408 00000100:00100000:0.0:1788836231.057837:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1788836231.057846:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529408:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.059144:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529408:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 1293us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.059155:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:1.0:1788836231.062940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.063094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529536 00000100:00100000:0.0:1788836231.063112:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529536 00000100:00100000:0.0:1788836231.063165:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:0.0:1788836231.063174:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529536:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.063539:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529536:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 365us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.063546:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1788836231.070896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.071271:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529664 00000100:00100000:0.0:1788836231.071285:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529664 00000100:00100000:0.0:1788836231.071398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:0.0:1788836231.071411:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:9979:x1875730518529664:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836231.072195:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:9979:x1875730518529664:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 780us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.072206:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:2.0:1788836231.076567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.076824:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529792 00000100:00100000:0.0:1788836231.076837:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529792 00000100:00100000:0.0:1788836231.076913:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:0.0:1788836231.076943:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:9979:x1875730518529792:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836231.077275:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+12:9979:x1875730518529792:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 333us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.077284:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:1.0:1788836231.080892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.081252:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518529920 00000100:00100000:0.0:1788836231.081265:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518529920 00000100:00100000:0.0:1788836231.081337:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:0.0:1788836231.081394:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+12:5592:x1875730518529920:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836231.081848:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836231.081883:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90954b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316a6fd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.081920:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90954b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6fd expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.081933:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90954b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6fd expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.081942:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031c00, rc 0) 00000100:00100000:0.0:1788836231.082013:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518529920:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 622us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.082021:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:1.0:1788836231.088328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836231.088613:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530048 00000100:00100000:3.0:1788836231.088628:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530048 00000100:00100000:3.0:1788836231.088701:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1788836231.088713:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518530048:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836231.089601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518530048:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 884us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.089612:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:2.0:1788836231.100241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836231.102719:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530176 00000100:00100000:1.0:1788836231.102740:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530176 00000100:00100000:1.0:1788836231.102823:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:1.0:1788836231.102835:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518530176:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.103179:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:5592:x1875730518530176:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 343us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.103188:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:1.0:1788836231.110309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836231.110920:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530304 00000100:00100000:0.0:1788836231.110933:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530304 00000100:00100000:0.0:1788836231.111004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:0.0:1788836231.111015:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:9981:x1875730518530304:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836231.115151:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ed1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:9981:x1875730518530304:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 4120us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.115170:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:0.0:1788836231.127486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836231.127654:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530432 00000100:00100000:3.0:1788836231.127666:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530432 00000100:00100000:3.0:1788836231.127738:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:3.0:1788836231.127750:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:9981:x1875730518530432:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836231.128083:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:9981:x1875730518530432:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 334us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.128093:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 256 10000000:01000000:2.0:1788836231.376574:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836231.376585:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd079eb5000 from 7 10000000:01000000:2.0:1788836231.376593:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836231.376658:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836231.376687:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836231.376701:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836231.376732:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538483840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.376832:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836231.377174:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.385598:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483840 00000100:00100000:0.0:1788836231.385618:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483840 00000100:00100000:0.0:1788836231.385711:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788836231.385723:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:5826:x1875730538483840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836231.385744:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836231.385770:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909552 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.385818:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909552 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.385832:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909552 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.385843:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:0.0:1788836231.386194:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538483840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 472us (9360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.386202:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788836231.386497:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538483840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836231.386520:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836231.386532:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836231.386649:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538483968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.386692:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836231.386740:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836231.387009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538483968 00000100:00100000:1.0:1788836231.387028:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538483968 00000100:00100000:1.0:1788836231.387092:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788836231.387124:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538483968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.388078:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538483968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 954us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.388087:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788836231.388257:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538483968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.388312:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.390302:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836231.390413:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.390586:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484096 00000100:00100000:0.0:1788836231.390598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484096 00000100:00100000:0.0:1788836231.390665:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788836231.390676:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538484096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.391315:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538484096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 639us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.391333:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788836231.395034:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.396469:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11665:1875730538484224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836231.396592:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836231.396670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484224 00000100:00100000:2.0:1788836231.396680:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836231.396680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484224 00000100:00100000:1.0:1788836231.396787:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788836231.396800:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:11665:x1875730538484224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836231.397091:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:11665:x1875730538484224:12345-0@lo:502:llog_process_th.0 Request processed in 292us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.397119:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788836231.397229:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11665:1875730538484224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836231.397263:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836231.397274:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836231.397277:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836231.397285:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd079eb5000 00000020:00000080:2.0:1788836231.397288:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836231.398036:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11665:1875730538484352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836231.398116:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836231.398166:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836231.398376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484352 00000100:00100000:3.0:1788836231.398385:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484352 00000100:00100000:3.0:1788836231.398582:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788836231.398594:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:11665:x1875730538484352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836231.398996:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:11665:x1875730538484352:12345-0@lo:502:llog_process_th.0 Request processed in 403us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.399006:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788836231.399038:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11665:1875730538484352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836231.399088:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836231.399097:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836231.399100:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788836231.399117:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788836231.400006:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788836231.400038:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836231.400054:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.400068:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836231.400082:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836231.400086:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd078fee000 from 7 10000000:01000000:1.0:1788836231.400089:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836231.400142:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.400150:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.400162:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836231.400189:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.400523:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836231.400580:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.400599:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484480 00000100:00100000:0.0:1788836231.400610:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484480 00000100:00100000:0.0:1788836231.400673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788836231.400685:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:5826:x1875730538484480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836231.400701:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836231.400718:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031a00/0xcb5b7bc40b909567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b909560 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.400747:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031a00/0xcb5b7bc40b909567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b909560 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.400760:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031a00/0xcb5b7bc40b909567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b909560 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.400771:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031a00, rc 0) 00000100:00100000:0.0:1788836231.400818:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538484480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.400826:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788836231.400904:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836231.400921:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.400930:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836231.400999:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.401030:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836231.401150:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.401600:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484608 00000100:00100000:0.0:1788836231.401607:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484608 00000100:00100000:1.0:1788836231.401687:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788836231.401696:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538484608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.402132:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538484608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.402141:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788836231.402220:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.402271:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.402324:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836231.402389:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd051523b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836231.402444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484736 00000100:00100000:2.0:1788836231.402450:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484736 00000100:00100000:2.0:1788836231.402494:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788836231.402502:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538484736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.402707:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538484736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836231.402717:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788836231.402728:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538484736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.403877:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11668:1875730538484864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836231.403952:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836231.404002:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0515233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836231.404063:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484864 00000100:00100000:1.0:1788836231.404187:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484864 00000100:00100000:1.0:1788836231.404303:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788836231.404315:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:11668:x1875730538484864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836231.404867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:11668:x1875730538484864:12345-0@lo:502:llog_process_th.0 Request processed in 554us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.404878:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788836231.405952:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11668:1875730538484864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836231.406203:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836231.406217:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836231.406220:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836231.406228:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd078fee000 00000020:00000080:2.0:1788836231.406566:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788836231.406688:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11668:1875730538484992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836231.406856:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836231.406903:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.407167:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538484992 00000100:00100000:0.0:1788836231.407176:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538484992 00000100:00100000:0.0:1788836231.407238:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788836231.407248:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:11668:x1875730538484992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836231.407973:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:11668:x1875730538484992:12345-0@lo:502:llog_process_th.0 Request processed in 722us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836231.407983:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788836231.408627:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11668:1875730538484992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836231.408672:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836231.408681:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836231.408684:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788836231.408689:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788836231.408927:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788836231.408953:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836231.408966:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.408980:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836231.408992:0:5826:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788836231.408995:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd0497a5800 from 7 10000000:01000000:0.0:1788836231.408999:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836231.409042:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.409050:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.409061:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836231.409097:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.409160:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836231.409234:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836231.409280:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485120 00000100:00100000:1.0:1788836231.409287:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485120 00000100:00100000:1.0:1788836231.409414:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788836231.409432:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:5826:x1875730538485120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836231.409448:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836231.409463:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90956e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.409492:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90956e expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.409504:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90956e expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.409515:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376000, rc 0) 00000100:00100000:1.0:1788836231.409554:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538485120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836231.409561:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788836231.409638:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836231.409652:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.409661:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836231.409713:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.409742:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836231.409812:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836231.409846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485248 00000100:00100000:2.0:1788836231.409850:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485248 00000100:00100000:2.0:1788836231.409873:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788836231.409880:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538485248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836231.410181:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538485248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836231.410189:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788836231.410283:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836231.410315:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836231.410987:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836231.411147:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836231.411204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485376 00000100:00100000:2.0:1788836231.411212:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485376 00000100:00100000:3.0:1788836231.411555:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788836231.411563:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538485376:12345-0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836231.411604:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836231.412027:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:5826:x1875730538485376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 459us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.412043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788836231.412068:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8e83d0f-78a2-4253-8765-c02f0116c7a1:5826:1875730538485376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836231.413316:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11670:1875730538485504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836231.413652:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836231.413738:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836231.413785:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485504 00000100:00100000:2.0:1788836231.413794:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485504 00000100:00100000:3.0:1788836231.413985:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788836231.413998:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:11670:x1875730538485504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836231.414489:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:11670:x1875730538485504:12345-0@lo:502:llog_process_th.0 Request processed in 492us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836231.414497:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788836231.414683:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11670:1875730538485504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836231.414740:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836231.414754:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836231.414757:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836231.414765:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd0497a5800 00000020:00000080:1.0:1788836231.414768:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788836231.414880:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11670:1875730538485632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836231.414934:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836231.414974:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e70cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836231.415188:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485632 00000100:00100000:0.0:1788836231.415196:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485632 00000100:00100000:0.0:1788836231.415248:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788836231.415271:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:11670:x1875730538485632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836231.416947:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:11670:x1875730538485632:12345-0@lo:502:llog_process_th.0 Request processed in 1678us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836231.416968:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788836231.417160:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8e83d0f-78a2-4253-8765-c02f0116c7a1:11670:1875730538485632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836231.417195:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836231.417203:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836231.417206:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788836231.417209:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788836231.417404:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788836231.417425:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836231.417434:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836231.417455:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836231.952691:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836232.390656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836232.390708:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836232.390747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836232.390780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836232.390815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530688 00000100:00100000:3.0:1788836232.390825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530688 00000100:00100000:3.0:1788836232.390900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530944 00000100:00100000:3.0:1788836232.390904:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530944 00000100:00100000:3.0:1788836232.390933:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1788836232.390945:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518530688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836232.391921:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518530688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 971us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836232.391932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1788836232.391968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:3.0:1788836232.391978:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518530944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1788836232.392379:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836232.392643:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530816 00000100:00100000:1.0:1788836232.392657:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530816 00000100:00100000:1.0:1788836232.392735:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788836232.392745:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518530816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836232.392809:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518530816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836232.392817:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00080000:2.0:1788836232.392964:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836232.393249:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2356:x1875730518530944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1271us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836232.393261:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:0.0:1788836232.393268:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518530560 00000100:00100000:0.0:1788836232.393276:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518530560 00000100:00100000:0.0:1788836232.393321:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00100000:0.0:1788836232.393330:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518530560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836232.393426:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518530560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836232.393435:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 272 00000040:00080000:3.0:1788836232.465870:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836232.976528:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788836233.638634:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1788836234.000508:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836234.064613:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538486144:0@lo:400:kworker.0 00000100:00100000:3.0:1788836234.064680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836234.064694:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538486272:0@lo:400:kworker.0 00000100:00100000:0.0:1788836234.064724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836234.064753:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486272 00000100:00100000:3.0:1788836234.064760:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486272 00000100:00100000:3.0:1788836234.064830:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836234.064839:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538486272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836234.064897:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538486272:12345-0@lo:400:kworker.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836234.064904:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836234.064924:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538485888:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788836234.064953:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd047eb4000 x1875730538486272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836234.064954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836234.064966:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538486272:0@lo:400:kworker.0 00000100:00100000:1.0:1788836234.064973:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788836234.064996:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485888 00000100:00100000:1.0:1788836234.064996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836234.064999:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485888 00000100:00100000:1.0:1788836234.065014:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538486400:0@lo:400:kworker.0 00000100:00100000:3.0:1788836234.065019:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836234.065025:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538485888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836234.065035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836234.065050:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00002000:00000024:3.0:1788836234.065051:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836234.065055:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538486016:0@lo:400:kworker.0 00000100:00100000:1.0:1788836234.065074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836234.065078:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538485888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836234.065094:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836234.065098:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538486528:0@lo:400:kworker.0 00000100:00100000:1.0:1788836234.065119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788836234.065167:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3dc00 x1875730538485888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836234.065181:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538485888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788836234.065242:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836234.065306:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486144 00000100:00100000:2.0:1788836234.065311:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486144 00000100:00100000:2.0:1788836234.065381:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486400 00000100:00100000:2.0:1788836234.065384:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486400 00000100:00100000:2.0:1788836234.065398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486016 00000100:00100000:2.0:1788836234.065400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486016 00000100:00100000:2.0:1788836234.065410:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836234.065416:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538486144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538486144:12345-0@lo:400:kworker.0 Request processed in 46us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836234.065468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836234.065481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836234.065486:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538486400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065514:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538486400:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836234.065519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836234.065528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788836234.065533:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538486016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538486016:12345-0@lo:400:kworker.0 Request processed in 21us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836234.065559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788836234.065573:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538485760 00000100:00100000:2.0:1788836234.065576:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538485760 00000100:00100000:2.0:1788836234.065597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788836234.065602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538485760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065627:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538485760:12345-0@lo:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836234.065632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788836234.065675:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065698:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065705:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538485760:0@lo:400:kworker.0 00000100:00100000:2.0:1788836234.065714:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538486400:0@lo:400:kworker.0 00000100:00080000:0.0:1788836234.065840:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836234.065933:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486528 00000100:00100000:3.0:1788836234.065945:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486528 00000100:00100000:3.0:1788836234.065988:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836234.065996:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538486528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836234.066040:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538486528:12345-0@lo:400:kworker.0 Request processed in 45us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836234.066045:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788836234.066142:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836234.066303:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788836234.066309:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07acb0e00, transno 4294967300 00000100:00100000:2.0:1788836234.066327:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538486528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836234.576748:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836234.576773:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538486656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836234.576845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836234.576990:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486656 00000100:00100000:1.0:1788836234.576997:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486656 00000100:00100000:1.0:1788836234.577044:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836234.577054:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538486656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836234.577099:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836234.577162:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538486656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836234.577170:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836234.577377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538486656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836235.024508:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836236.048506:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836237.072497:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836237.511843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836237.511891:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836237.511934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836237.511972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836237.512004:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531328 00000100:00100000:1.0:1788836237.512014:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531328 00000100:00100000:2.0:1788836237.512175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531200 00000100:00100000:2.0:1788836237.512179:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531200 00000100:00100000:2.0:1788836237.512213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531456 00000100:00100000:2.0:1788836237.512216:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531456 00000100:00100000:2.0:1788836237.512239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1788836237.512249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518531200:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836237.512331:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518531200:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836237.512339:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1788836237.512398:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1788836237.512404:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518531456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836237.512431:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518531456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836237.512437:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:0.0:1788836237.512764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531072 00000100:00100000:0.0:1788836237.512769:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531072 00000100:00100000:0.0:1788836237.512809:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:0.0:1788836237.512817:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518531072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836237.512852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518531072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836237.512871:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00080000:0.0:1788836237.512897:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836237.512902:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836237.513411:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1788836237.513425:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518531328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836237.513480:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518531328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 61us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836237.513487:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00010000:00010000:1.0:1788836238.096511:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836239.121229:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836239.184645:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538487168:0@lo:400:kworker.0 00000100:00100000:0.0:1788836239.184729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836239.184738:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538486784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.184836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836239.184889:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486784 00000100:00100000:1.0:1788836239.184894:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487296:0@lo:400:kworker.0 00000100:00100000:0.0:1788836239.184899:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486784 00000100:00100000:1.0:1788836239.184935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836239.184974:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788836239.184987:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538486784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.184997:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487296 00000100:00100000:1.0:1788836239.185024:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487296 00000100:00100000:0.0:1788836239.185072:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538486784:12345-0@lo:400:kworker.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836239.185081:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788836239.185107:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836239.185120:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788836239.185129:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836239.185169:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538486784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.185186:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487296:12345-0@lo:400:kworker.0 Request processed in 68us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836239.185198:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788836239.185198:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd047eb7100 x1875730538487296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836239.185216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836239.185369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487168 00000100:00100000:3.0:1788836239.185376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487168 00000100:00100000:3.0:1788836239.185447:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836239.185456:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538487168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836239.185505:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538487168:12345-0@lo:400:kworker.0 Request processed in 51us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836239.185512:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836239.185559:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538487168:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.185663:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538486912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836239.185697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836239.185723:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538487424:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.185758:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836239.185802:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538486912 00000100:00100000:3.0:1788836239.185807:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538486912 00000100:00080000:0.0:1788836239.185871:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836239.194084:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538487040:0@lo:400:kworker.0 00000100:00100000:0.0:1788836239.194658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836239.194736:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd047eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538487552:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.194773:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487424 00000100:00100000:0.0:1788836239.194784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836239.194790:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487424 00000100:00100000:0.0:1788836239.194937:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487552 00000100:00100000:0.0:1788836239.194946:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487552 00000100:00100000:0.0:1788836239.194999:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836239.195008:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.195099:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487040 00000100:00100000:1.0:1788836239.195106:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487040 00000100:00100000:0.0:1788836239.195108:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538487552:12345-0@lo:400:kworker.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836239.195119:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836239.195146:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788836239.195150:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836239.195157:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836239.195160:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538487424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836239.195201:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538487552:0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.195248:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538487424:12345-0@lo:400:kworker.0 Request processed in 91us (9486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836239.195257:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836239.195269:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788836239.195282:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538487040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836239.195313:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538487424:0@lo:400:kworker.0 00000100:00100000:0.0:1788836239.195387:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538487040:12345-0@lo:400:kworker.0 Request processed in 107us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836239.195397:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788836239.195430:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd047eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538487040:0@lo:400:kworker.0 00000100:00100000:3.0:1788836239.202739:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836239.202784:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538486912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836239.202852:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836239.202989:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538486912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (17290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836239.203018:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788836239.203870:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07ae3ed80 x1875730538486912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836239.203901:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538486912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836239.697648:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836239.698279:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836239.698404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836239.699272:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487680 00000100:00100000:3.0:1788836239.699284:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487680 00000100:00100000:3.0:1788836239.699439:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836239.699451:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836239.699498:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836239.699587:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836239.699595:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836239.699691:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836240.154105:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836241.168451:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836242.192495:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836242.629317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836242.629394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836242.630475:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531584 00000100:00100000:3.0:1788836242.630486:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531584 00000100:00100000:3.0:1788836242.630548:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 276 00000100:00100000:3.0:1788836242.630559:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518531584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836242.630642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518531584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836242.630650:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 276 00000100:00100000:1.0:1788836242.630791:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531712 00000100:00100000:1.0:1788836242.630795:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531712 00000100:00100000:1.0:1788836242.630846:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:1.0:1788836242.630854:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518531712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836242.630898:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518531712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836242.630905:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00080000:3.0:1788836242.631077:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836242.646178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836242.646224:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836242.646310:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531840 00000100:00100000:3.0:1788836242.646319:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531840 00000100:00100000:3.0:1788836242.646418:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836242.646429:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2352:x1875730518531840:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788836242.646462:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9094b1 00000100:00080000:3.0:1788836242.646472:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9bd047f5e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836242.646508:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788836242.646878:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+2:2352:x1875730518531840:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 451us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836242.646901:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788836242.647412:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518531968 00000100:00100000:1.0:1788836242.647418:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518531968 00000100:00100000:1.0:1788836242.647462:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1788836242.647470:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518531968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836242.647522:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518531968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836242.647529:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00010000:00010000:1.0:1788836242.647551:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836242.647653:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836242.647658:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788836242.705411:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836243.216574:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836243.879156:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:3.0:1788836243.879165:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bd047f58000/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:0.0:1788836243.879258:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f58000/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-OST0001 00000020:00000080:0.0:1788836243.879374:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd047f5e800 for lustre-OST0001 00010000:00010000:1.0:1788836244.240504:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836244.307300:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538487936:0@lo:400:kworker.0 00000100:00100000:2.0:1788836244.307406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836244.307465:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538488448:0@lo:400:kworker.0 00000100:00100000:2.0:1788836244.307491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836244.307534:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836244.307540:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538488064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836244.307563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836244.307578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538488576:0@lo:400:kworker.0 00000100:00100000:2.0:1788836244.307602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836244.307672:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487936 00000100:00100000:0.0:1788836244.307680:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487936 00000100:00100000:0.0:1788836244.307732:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788836244.307742:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538487936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836244.307808:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538487936:12345-0@lo:400:kworker.0 Request processed in 58us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836244.307821:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788836244.307855:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488576 00000100:00100000:0.0:1788836244.307859:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488576 00000100:00100000:0.0:1788836244.307904:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788836244.307911:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538488576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836244.307944:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538488576:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836244.307950:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788836244.307966:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836244.307994:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538488576:0@lo:400:kworker.0 00000100:00100000:0.0:1788836244.308002:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538487936:0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308303:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836244.308339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836244.308392:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538488320:0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836244.308430:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836244.308436:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538488192:0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836244.308495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488448 00000100:00100000:1.0:1788836244.308500:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488448 00000100:00100000:1.0:1788836244.308533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488064 00000100:00100000:1.0:1788836244.308536:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488064 00000100:00100000:1.0:1788836244.308548:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488192 00000100:00100000:1.0:1788836244.308551:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488192 00000100:00100000:1.0:1788836244.308565:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836244.308572:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538488448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538488448:12345-0@lo:400:kworker.0 Request processed in 36us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836244.308612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836244.308623:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836244.308628:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308652:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538488064:12345-0@lo:400:kworker.0 Request processed in 24us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836244.308658:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836244.308669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788836244.308674:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538488192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308702:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538488192:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836244.308708:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788836244.308727:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488320 00000100:00100000:1.0:1788836244.308743:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488320 00000100:00100000:1.0:1788836244.308768:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788836244.308774:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538488320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.308872:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538488320:12345-0@lo:400:kworker.0 Request processed in 96us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836244.308957:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788836244.308979:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836244.308983:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836244.309006:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538488192:0@lo:400:kworker.0 00010000:00080000:1.0:1788836244.309028:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454bb800 x1875730538488320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836244.309039:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538488320:0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.309068:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538488064:0@lo:400:kworker.0 00000100:00100000:1.0:1788836244.309078:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538488448:0@lo:400:kworker.0 00000100:00100000:0.0:1788836244.311956:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538487808 00000100:00100000:0.0:1788836244.311971:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538487808 00000100:00100000:0.0:1788836244.312052:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788836244.312063:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836244.312106:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836244.312201:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538487808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836244.312208:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788836244.312441:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd078fb5f80 x1875730538487808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836244.312462:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd078fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538487808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836244.816710:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538488704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836244.816791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836244.817021:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488704 00000100:00100000:0.0:1788836244.817029:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488704 00000100:00100000:0.0:1788836244.817075:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836244.817084:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538488704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836244.817116:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836244.817170:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538488704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836244.817188:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788836244.817445:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538488704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836245.264497:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836246.288760:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836247.312785:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836247.753712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836247.753775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836247.753795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532096 00000100:00100000:0.0:1788836247.753805:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532096 00000100:00100000:3.0:1788836247.753810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836247.753852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 278 00000100:00100000:0.0:1788836247.753864:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518532096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836247.753938:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518532096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836247.753945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 278 00000100:00100000:1.0:1788836247.754027:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532224 00000100:00100000:1.0:1788836247.754032:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532224 00000100:00100000:1.0:1788836247.754080:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532352 00000100:00100000:1.0:1788836247.754084:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532352 00000100:00100000:1.0:1788836247.754106:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788836247.754114:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518532224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836247.754152:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518532224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836247.754173:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788836247.754188:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1788836247.754194:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518532352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836247.754221:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518532352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836247.754227:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00080000:0.0:1788836247.754558:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836248.336509:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836249.360514:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836249.424623:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538488832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836249.424692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836249.425025:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488832 00000100:00100000:3.0:1788836249.425032:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488832 00000100:00100000:3.0:1788836249.425086:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836249.425093:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538488832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836249.425119:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788836249.425182:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836249.425329:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538488960:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836249.425419:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836249.425425:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836249.425476:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489088 00000100:00100000:0.0:1788836249.425480:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489088 00000100:00100000:0.0:1788836249.425507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836249.425514:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425548:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538489088:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836249.425556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836249.425594:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425630:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538489216:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836249.425702:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489216 00000100:00100000:0.0:1788836249.425705:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489216 00000100:00100000:0.0:1788836249.425731:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788836249.425738:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538489216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425770:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538489216:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836249.425776:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788836249.425792:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836249.425806:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538489216:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425830:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538488960 00000100:00100000:0.0:1788836249.425834:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538488960 00000100:00100000:0.0:1788836249.425857:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788836249.425863:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538488960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.425894:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538488960:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836249.425900:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788836249.425929:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538488960:0@lo:400:kworker.0 00000100:00100000:3.0:1788836249.426145:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538488832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1051us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836249.426154:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788836249.426235:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454ba680 x1875730538488832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836249.426252:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538488832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836249.426407:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788836249.426435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836249.426540:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836249.426550:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538489472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836249.426579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836249.426606:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489472 00000100:00100000:2.0:1788836249.426610:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489472 00000100:00100000:2.0:1788836249.426644:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836249.426651:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538489472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788836249.426798:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836249.426891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489344 00000100:00100000:0.0:1788836249.426895:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489344 00000100:00100000:0.0:1788836249.426927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788836249.426934:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538489344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836249.426992:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538489472:12345-0@lo:400:kworker.0 Request processed in 332us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836249.427000:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788836249.427022:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836249.427093:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538489472:0@lo:400:kworker.0 00000100:00100000:0.0:1788836249.427141:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538489344:12345-0@lo:400:kworker.0 Request processed in 207us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836249.427148:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788836249.427195:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538489344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836249.936918:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836249.936949:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538489600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836249.937050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836249.937168:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489600 00000100:00100000:0.0:1788836249.937180:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489600 00000100:00100000:0.0:1788836249.937247:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836249.937274:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538489600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836249.937633:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836249.937704:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538489600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 432us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836249.937712:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788836249.937810:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538489600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788836250.392503:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836251.408938:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836252.432513:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836252.882544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836252.882582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836252.882611:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836252.882653:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532736 00000100:00100000:3.0:1788836252.882662:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532736 00000100:00100000:3.0:1788836252.882717:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532608 00000100:00100000:3.0:1788836252.882720:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532608 00000100:00100000:3.0:1788836252.882763:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788836252.882774:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518532736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836252.882848:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518532736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836252.882857:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788836252.882883:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788836252.882890:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518532608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836252.882917:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518532608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836252.882923:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00080000:3.0:1788836252.882942:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836252.883156:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532480 00000100:00100000:0.0:1788836252.883161:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532480 00000100:00100000:0.0:1788836252.883194:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 280 00000100:00100000:0.0:1788836252.883201:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518532480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836252.883230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518532480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836252.883236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 280 00000040:00080000:3.0:1788836252.959750:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788836253.269796:0:11833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:57:30 (1788836250) 00010000:00010000:2.0:1788836253.456547:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836254.483135:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836254.547959:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538489856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538490368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548163:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836254.548169:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538489728:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548215:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538490240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548262:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538489984:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548304:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538490496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836254.548326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548370:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836254.548376:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538490112:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836254.548428:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489728 00000100:00100000:1.0:1788836254.548434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489728 00000100:00100000:3.0:1788836254.548464:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489856 00000100:00100000:3.0:1788836254.548468:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489856 00000100:00100000:1.0:1788836254.548473:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788836254.548481:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538489728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836254.548491:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538490240 00000100:00100000:3.0:1788836254.548493:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538490240 00000100:00100000:3.0:1788836254.548527:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538489984 00000100:00100000:3.0:1788836254.548530:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538489984 00000100:00100000:1.0:1788836254.548530:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538489728:12345-0@lo:400:kworker.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836254.548537:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788836254.548544:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788836254.548549:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538489856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548568:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538490496 00000100:00100000:1.0:1788836254.548571:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538490496 00000100:00100000:3.0:1788836254.548583:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538489856:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836254.548589:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788836254.548598:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836254.548599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788836254.548604:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538490240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548604:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538490496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836254.548626:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538490240:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836254.548636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00002000:00000024:1.0:1788836254.548637:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836254.548646:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788836254.548651:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538489984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548669:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538490496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836254.548674:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538489984:12345-0@lo:400:kworker.0 Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836254.548675:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836254.548679:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788836254.548691:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538490368 00000100:00100000:1.0:1788836254.548694:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538490368 00000100:00080000:3.0:1788836254.548696:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836254.548699:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836254.548701:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836254.548716:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538490112 00000100:00100000:1.0:1788836254.548719:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538490112 00000100:00100000:1.0:1788836254.548731:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836254.548737:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538490368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548766:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538490368:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836254.548772:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836254.548782:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836254.548788:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538490112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548812:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538490112:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836254.548818:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836254.548834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538489728:0@lo:400:kworker.0 00010000:00080000:1.0:1788836254.548839:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a725500 x1875730538490112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836254.548845:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538490240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538490112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836254.548854:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538489856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836254.548857:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538489984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836254.548861:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538490368:0@lo:400:kworker.0 00010000:00080000:1.0:1788836254.548865:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd0454b8380 x1875730538490496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836254.548875:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538490496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836255.056509:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836255.056600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836255.057421:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538490624 00000100:00100000:2.0:1788836255.057430:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538490624 00000100:00100000:2.0:1788836255.057490:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788836255.057499:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538490624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836255.057537:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836255.057600:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538490624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836255.057624:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788836255.057813:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836255.142823:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836255.143559:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532864 00000100:00100000:0.0:1788836255.143570:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532864 00000100:00080000:3.0:1788836255.143927:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836255.144041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1788836255.144055:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+5:10248:x1875730518532864:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836255.144074:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836255.144094:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b90957c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a704 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144149:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144162:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144173:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836255.144216:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836255.144220:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836255.144257:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144279:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b90957c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a704 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144295:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a704 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.144304:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:0.0:1788836255.144307:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836255.144310:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:0.0:1788836255.144607:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:10248:x1875730518532864:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 554us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836255.144614:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788836255.154504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836255.154666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518532992 00000100:00100000:0.0:1788836255.154675:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518532992 00000100:00100000:0.0:1788836255.154743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788836255.154754:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:10249:x1875730518532992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836255.154773:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836255.154794:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b90958a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a70b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154857:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154884:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154896:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154913:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154920:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.154926:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155149:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155158:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155166:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836255.155191:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788836255.155195:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836255.155635:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155649:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155666:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155672:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155678:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836255.155683:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155839:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155857:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:0.0:1788836255.155860:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836255.155865:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155885:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155892:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155898:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155903:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dbc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836255.155913:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155920:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155927:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd0498ed100) 00010000:00010000:0.0:1788836255.155930:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836255.155933:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155939:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909598 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.155986:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b90958a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a70b expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.156001:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a70b expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836255.156009:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed600) 00010000:00010000:0.0:1788836255.156012:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836255.156014:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820da000, rc 0) 00000100:00100000:0.0:1788836255.156122:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:10249:x1875730518532992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1369us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836255.156130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788836255.178170:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836255.185378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518533248 00000100:00100000:1.0:1788836255.185393:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518533248 00000100:00100000:1.0:1788836255.185526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788836255.185538:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:10249:x1875730518533248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836255.185560:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836255.185581:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a712 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185652:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185667:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185677:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185747:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185755:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.185762:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.186575:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9095bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.186587:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9095bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.186595:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9095bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836255.186604:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788836255.189523:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189541:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189549:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189556:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836255.189561:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189569:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189585:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed600) 00010000:00010000:1.0:1788836255.189588:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836255.189593:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189635:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189642:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189648:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189653:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836255.189657:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189663:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189671:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd07a955600) 00010000:00010000:1.0:1788836255.189674:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836255.189677:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.189683:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9095b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.196336:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a712 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.196389:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9095bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a712 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836255.196413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:1.0:1788836255.196416:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836255.196419:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376800, rc 0) 00000100:00100000:1.0:1788836255.196559:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+9:10249:x1875730518533248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 11022us (18396us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788836255.196569:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788836255.206095:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836255.206217:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518533376 00000100:00100000:0.0:1788836255.206228:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518533376 00000100:00100000:0.0:1788836255.206287:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836255.206299:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+9:10249:x1875730518533376:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788836255.206463:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+9:10249:x1875730518533376:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 166us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836255.206471:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00010000:00010000:1.0:1788836255.504510:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836256.019005:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836256.529541:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836257.254672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.257454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518533504 00000100:00100000:1.0:1788836257.257471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518533504 00000100:00100000:1.0:1788836257.257619:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788836257.257633:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:10292:x1875730518533504:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836257.257657:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836257.257683:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9095c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a719 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257864:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257878:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257891:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257905:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257913:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.257931:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258324:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258332:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258338:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258367:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836257.258372:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258380:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258392:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:1.0:1788836257.258395:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.258400:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258405:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9095d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258417:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258423:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258435:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258439:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836257.258442:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258448:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258455:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd07a955600) 00010000:00010000:1.0:1788836257.258458:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.258461:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258466:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9095d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258501:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9095c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a719 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258511:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:1.0:1788836257.258514:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.258517:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9095c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a719 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.258526:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376400, rc 0) 00000100:00100000:1.0:1788836257.258592:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:10292:x1875730518533504:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 963us (3929us total) trans 0 rc 301/301 00000100:00100000:1.0:1788836257.259779:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00080000:3.0:1788836257.260967:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836257.271578:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836257.272000:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518533760 00000100:00100000:0.0:1788836257.272010:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518533760 00000100:00100000:0.0:1788836257.272088:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788836257.272098:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+9:10292:x1875730518533760:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1788836257.272153:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836257.272179:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a704 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272197:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:0.0:1788836257.272207:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836257.272442:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272456:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272465:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272478:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272485:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.272491:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836257.279527:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788836257.279547:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.279558:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.279576:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.279581:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836257.279585:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.279593:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.280116:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd0498ed100) 00010000:00010000:3.0:1788836257.280121:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836257.280128:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.280135:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b9095de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836257.280155:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003949dd64 reply state 000000003e377470 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.280164:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836257.280965:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+10:10292:x1875730518533760:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 8861us (9388us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788836257.280976:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00010000:00010000:1.0:1788836257.291502:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291521:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291530:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291538:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836257.291544:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291552:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291571:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd0498edc00) 00010000:00010000:1.0:1788836257.291575:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.291580:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.291587:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9095e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.434379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.436037:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518533888 00000100:00100000:2.0:1788836257.436050:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518533888 00000100:00100000:2.0:1788836257.436112:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788836257.436122:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:10300:x1875730518533888:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788836257.436146:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.436168:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b9095ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a720 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436232:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436247:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436257:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836257.436292:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836257.436296:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836257.436358:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436384:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b9095ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a720 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436399:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a720 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.436426:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:2.0:1788836257.436430:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836257.436433:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999600, rc 0) 00000100:00100000:2.0:1788836257.436513:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+10:10300:x1875730518533888:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 392us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.436520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1788836257.485876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.486470:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534016 00000100:00100000:3.0:1788836257.486481:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534016 00000100:00100000:0.0:1788836257.486830:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836257.486842:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+10:10306:x1875730518534016:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836257.486863:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836257.486881:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9095fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a727 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.486986:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487000:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487011:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487026:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487034:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487040:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487133:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487141:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487161:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836257.487188:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788836257.487191:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836257.487239:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487252:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487257:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487264:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487270:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836257.487274:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487281:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487292:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:0.0:1788836257.487295:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836257.487300:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487521:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487547:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487553:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487559:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487564:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836257.487567:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487573:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487582:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd0498eda00) 00010000:00010000:0.0:1788836257.487585:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836257.487588:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487594:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487646:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9095fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a727 expref: 12 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.487661:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a727 expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.488011:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836257.488014:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788836257.488017:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820da400, rc 0) 00000100:00100000:0.0:1788836257.488458:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+11:10306:x1875730518534016:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1615us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836257.488468:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836257.507059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.507212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534272 00000100:00100000:1.0:1788836257.507222:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534272 00000100:00100000:1.0:1788836257.507288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788836257.507299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+11:10306:x1875730518534272:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836257.507339:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836257.507610:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909616 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a72e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507740:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507754:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507766:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507876:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507886:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.507894:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836257.509601:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788836257.509778:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509793:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509802:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509849:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509856:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509862:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509867:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836257.509872:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509878:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509891:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836257.509893:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.509898:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b90961d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836257.509916:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbbc73fa reply state 00000000ac5825f5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836257.509924:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788836257.509969:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909616 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.509994:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.510001:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836257.510003:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836257.510005:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376e00, rc 0) 00000100:00100000:1.0:1788836257.510084:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:10306:x1875730518534272:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2787us (3036us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788836257.510091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00010000:00010000:1.0:1788836257.511417:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511431:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511436:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511441:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836257.511444:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511451:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511463:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955600) 00010000:00010000:1.0:1788836257.511465:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836257.511469:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.511485:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836257.515776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.517331:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534400 00000100:00100000:3.0:1788836257.518224:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534400 00000100:00100000:3.0:1788836257.518441:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836257.518450:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518534400:12345-192.168.203.52@tcp:8:bash.0 00010000:00080000:3.0:1788836257.518484:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1788836257.518517:0:6680:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b909639 00002000:00100000:3.0:1788836257.518529:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 539937c3-f568-41e1-b7b5-fe9413243b52/ffff9bcf45115800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788836257.518554:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788836257.518927:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836257.518968:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bcf45114000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836257.519049:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518534400:12345-192.168.203.52@tcp:8:bash.0 Request processed in 598us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836257.519057:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836257.525168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.525418:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534528 00000100:00100000:2.0:1788836257.525428:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534528 00000100:00100000:2.0:1788836257.525508:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788836257.525517:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:0:x1875730518534528:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788836257.525532:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.525554:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a735 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836257.525578:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836257.525594:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1788836257.525598:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836257.525606:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.525623:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.525636:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836257.525695:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:0:x1875730518534528:12345-192.168.203.52@tcp:101:bash.0 Request processed in 180us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.525711:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00080000:3.0:1788836257.526502:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836257.534173:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.537228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534656 00000100:00100000:1.0:1788836257.537243:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534656 00000100:00100000:1.0:1788836257.537388:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788836257.537399:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:10306:x1875730518534656:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836257.537416:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836257.537435:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a73c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.537464:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.537481:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836257.537485:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836257.537490:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.537523:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.537535:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 8 pid: 6683 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836257.537549:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0794e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875730538490752:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836257.537657:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836257.546596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836257.546751:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518534784 00000100:00100000:0.0:1788836257.546759:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518534784 00010000:00010000:0.0:1788836257.546794:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 9 pid: 6683 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836257.546836:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836257.546844:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518534784:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836257.546858:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836257.546880:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 9 pid: 6683 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.546895:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 9 pid: 6683 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.546923:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836257.546927:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836257.546954:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.546965:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.547001:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836257.547015:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5815:1875730538490880:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788836257.547101:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6540 going to sleep for 11 seconds 00010000:00010000:3.0:1788836257.550233:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c76a8a5/0xcb5b7bc40b909640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a735 expref: 9 pid: 6683 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.550264:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0794e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875730538490752:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836257.550303:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.550318:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376400, rc 0) 00000100:00100000:3.0:1788836257.551221:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+8:10306:x1875730518534656:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13820us (17053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836257.551231:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:1.0:1788836257.552838:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836257.553356:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5815:1875730538490880:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788836257.553395:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836257.553469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518534784:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 6624us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836257.553479:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836257.556711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.556838:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518535040 00000100:00100000:1.0:1788836257.556848:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518535040 00000100:00100000:1.0:1788836257.556906:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836257.556917:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:10306:x1875730518535040:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836257.557283:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+14:10306:x1875730518535040:12345-192.168.203.52@tcp:35:bash.0 Request processed in 366us (580us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788836257.557291:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836257.694716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.694835:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518535296 00000100:00100000:2.0:1788836257.694846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518535296 00000100:00100000:2.0:1788836257.694914:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788836257.694924:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+14:10316:x1875730518535296:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836257.694958:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.694976:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90964e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a743 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836257.695066:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788836257.695183:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90964e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a743 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.695196:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:2.0:1788836257.695200:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836257.695205:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90964e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a743 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.695219:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998a00, rc 0) 00000100:00100000:2.0:1788836257.695282:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+15:10316:x1875730518535296:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 360us (576us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788836257.695289:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788836257.712474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.712652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518535552 00000100:00100000:1.0:1788836257.712662:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518535552 00000100:00100000:1.0:1788836257.712769:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836257.712780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+15:10316:x1875730518535552:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836257.713126:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:10316:x1875730518535552:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 347us (726us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788836257.713134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788836257.851239:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.851386:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518535680 00000100:00100000:2.0:1788836257.851396:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518535680 00000100:00100000:2.0:1788836257.851451:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788836257.851460:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:10322:x1875730518535680:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836257.851492:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.851510:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90965c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a74a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851573:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851587:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851597:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836257.851629:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788836257.851633:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836257.851650:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851676:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90965c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a74a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851705:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a74a expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.851713:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:2.0:1788836257.851716:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836257.851720:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998000, rc 0) 00000100:00100000:2.0:1788836257.851782:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:10322:x1875730518535680:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 322us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.851789:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788836257.865709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.865812:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518535936 00000100:00100000:2.0:1788836257.865822:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518535936 00000100:00100000:2.0:1788836257.865877:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788836257.865887:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+17:10322:x1875730518535936:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836257.865908:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.865927:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90966a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a751 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.866026:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.866039:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.866050:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836257.866059:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788836257.866197:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90966a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a751 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.866213:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a751 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.866231:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836257.866234:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836257.866237:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998200, rc 0) 00000100:00100000:2.0:1788836257.866296:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:10322:x1875730518535936:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 411us (598us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788836257.866312:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788836257.870556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.870648:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536064 00000100:00100000:1.0:1788836257.870657:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536064 00000100:00100000:1.0:1788836257.870724:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836257.870734:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:2356:x1875730518536064:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836257.870750:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836257.870773:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a751 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836257.870806:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836257.870811:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836257.870871:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+18:2356:x1875730518536064:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836257.870878:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836257.875873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.875964:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536320 00000100:00100000:2.0:1788836257.875974:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536320 00000100:00100000:2.0:1788836257.876030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788836257.876041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:10322:x1875730518536320:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836257.876064:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.876083:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90967f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a758 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.876179:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.876193:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.876204:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836257.876214:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788836257.876361:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90967f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a758 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.876378:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a758 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.876385:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836257.876388:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836257.876391:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836257.876458:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:10322:x1875730518536320:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 419us (595us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788836257.876465:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788836257.886323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.886527:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536448 00000100:00100000:3.0:1788836257.886536:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536448 00000100:00100000:3.0:1788836257.886594:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788836257.886603:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518536448:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788836257.886657:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.886676:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.886684:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788836257.886700:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836257.886705:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.886760:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.886774:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 7 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.886788:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538491008:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836257.887498:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836257.891606:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538491008:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836257.891641:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836257.894111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.894207:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536576 00000100:00100000:2.0:1788836257.894217:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536576 00002000:00100000:2.0:1788836257.894270:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bd043070380 x1875730518536576/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:423/0 lens 504/0 e 0 to 0 dl 1788836268 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836257.894282:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd043070380 with x1875730518536576 ext(0->12) 00010000:00010000:2.0:1788836257.894290:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.894305:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 8 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836257.894313:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd043070380 00000100:00100000:2.0:1788836257.894373:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836257.894381:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518536576:12345-192.168.203.52@tcp:4:lfs.0 00000001:00100000:3.0:1788836257.952453:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000100:00100000:2.0:1788836257.957054:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518536576:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 62665us (62942us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788836257.957067:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:2.0:1788836257.957080:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9bd043070380 x1875730518536576/t4294967299(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:423/0 lens 504/448 e 0 to 0 dl 1788836268 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836257.957090:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd043070380 with x1875730518536576 ext(0->12) 00010000:00010000:2.0:1788836257.957100:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.957133:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836257.957142:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd043070380 00000100:00100000:0.0:1788836257.964082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.964317:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536704 00000100:00100000:3.0:1788836257.964326:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536704 00010000:00010000:3.0:1788836257.964425:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.964465:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788836257.964475:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518536704:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836257.964488:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788836257.964508:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788836257.964511:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788836256 00002000:00010000:3.0:1788836257.964513:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788836256 00002000:00010000:3.0:1788836257.964515:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788836256 00010000:00010000:3.0:1788836257.964521:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.964535:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.964566:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bccac31a/0xcb5b7bc40b909647 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a73c expref: 9 pid: 6681 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.964585:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836257.964590:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836257.964595:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.964627:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.964799:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836257.964859:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518536704:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 385us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836257.964867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00010000:00010000:0.0:1788836257.966305:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836257.966321:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966808:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966819:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966828:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966836:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836257.966840:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966849:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966867:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.966875:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b909694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836257.971989:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518536448:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 85374us (85665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.972005:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788836257.975973:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.976058:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518536960 00000100:00100000:3.0:1788836257.976068:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518536960 00000100:00100000:3.0:1788836257.976125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788836257.976136:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:10322:x1875730518536960:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788836257.976234:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a758 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836257.976914:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788836257.976988:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788836257.977564:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788836257.977701:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.977867:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.977879:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.977923:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.977949:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 24 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836257.977964:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875730538491136:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836257.978075:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836257.981161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836257.981408:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537088 00000100:00100000:3.0:1788836257.981417:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537088 00010000:00010000:3.0:1788836257.981457:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 25 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836257.981467:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875730538491136:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836257.981488:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.981514:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788836257.981522:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:2353:x1875730518537088:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836257.981536:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836257.981545:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 25 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981570:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 25 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981596:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90962b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a72e expref: 25 pid: 5831 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981613:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836257.981618:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981627:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981634:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836257.981661:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836257.981693:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.981700:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836257.981728:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:2353:x1875730518537088:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 206us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836257.981735:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000001:00080000:2.0:1788836257.982152:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788836257.982388:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788836257.982519:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538491264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788836257.982687:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836257.982881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538491264 00000100:00100000:1.0:1788836257.982887:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538491264 00000100:00100000:1.0:1788836257.982956:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836257.982964:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538491264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788836257.983029:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538491264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836257.983035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788836257.983087:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836257.983246:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836257.983270:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538491264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788836257.984224:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788836257.984294:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538491392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788836257.984378:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836257.984408:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836257.984432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538491392 00000100:00100000:1.0:1788836257.984438:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538491392 00000100:00100000:1.0:1788836257.984472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836257.984480:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538491392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788836257.984642:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875730538491392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (300us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788836257.984650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836257.984799:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538491392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788836257.984843:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788836257.984877:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984886:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984894:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984900:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836257.984912:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984920:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984944:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836257.984947:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788836257.984952:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.984959:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90969b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836257.985126:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788836257.985381:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788836257.985393:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311120049924ns, next at 312120047076ns, rc = 0 00000001:00080000:2.0:1788836257.985400:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788836257.985431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836257.985434:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836257.985441:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909686 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a758 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836257.985541:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:10322:x1875730518536960:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 9407us (9579us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788836257.985549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000020:00080000:2.0:1788836257.985553:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788836257.988442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.988533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537216 00000100:00100000:2.0:1788836257.988543:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537216 00000100:00100000:2.0:1788836257.988600:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1788836257.988610:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+27:10322:x1875730518537216:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836257.988647:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836257.988667:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9096a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a75f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.988732:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9096a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a75f expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.988747:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9096a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a75f expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836257.988765:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:2.0:1788836257.988768:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836257.988771:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999800, rc 0) 00000100:00100000:2.0:1788836257.988832:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+28:10322:x1875730518537216:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 224us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.988839:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788836257.989225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836257.989327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836257.989425:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537472 00000100:00100000:2.0:1788836257.989431:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537472 00000100:00100000:2.0:1788836257.989472:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1788836257.989479:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518537472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836257.989516:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518537472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836257.989523:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788836257.989550:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537344 00000100:00100000:3.0:1788836257.989555:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537344 00000100:00100000:3.0:1788836257.989592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 282 00000100:00080000:0.0:1788836257.989595:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836257.989599:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518537344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836257.989635:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518537344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836257.989653:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 282 00000100:00100000:2.0:1788836257.995916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836257.995980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537728 00000100:00100000:1.0:1788836257.995989:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537728 00000100:00100000:1.0:1788836257.996045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788836257.996057:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+28:10322:x1875730518537728:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836257.996296:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:10322:x1875730518537728:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 240us (389us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788836257.996316:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788836258.130963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836258.131058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518537984 00000100:00100000:2.0:1788836258.131068:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518537984 00000100:00100000:2.0:1788836258.131135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788836258.131163:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:10332:x1875730518537984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836258.131187:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836258.131206:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b9096a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a766 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836258.131287:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788836258.131797:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b9096a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a766 expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.131812:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:2.0:1788836258.131815:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836258.131820:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b9096a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a766 expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.131834:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836258.132201:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+30:10332:x1875730518537984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1038us (1245us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788836258.132209:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788836258.143140:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836258.143229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518538112 00000100:00100000:2.0:1788836258.143240:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518538112 00000100:00100000:2.0:1788836258.143299:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788836258.143308:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+30:10332:x1875730518538112:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788836258.143419:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143437:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143467:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143491:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143499:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143506:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143595:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143604:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143621:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836258.143661:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143674:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143681:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143687:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143704:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836258.143708:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143715:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143867:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:2.0:1788836258.143870:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836258.143875:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143880:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b9096b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143893:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143899:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143905:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143910:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836258.143913:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143919:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143946:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd04940be00) 00010000:00010000:2.0:1788836258.143948:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836258.143951:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143956:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b9096be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143971:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143977:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143983:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143988:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836258.143991:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.143997:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.144004:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:2.0:1788836258.144006:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836258.144009:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.144014:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836258.144092:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+30:10332:x1875730518538112:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 783us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836258.144099:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788836258.150037:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836258.150127:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518538368 00000100:00100000:1.0:1788836258.150136:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518538368 00000100:00100000:1.0:1788836258.150232:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836258.150242:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+30:10332:x1875730518538368:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836258.150498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+31:10332:x1875730518538368:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 257us (472us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788836258.150505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836258.215525:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.215615:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518538624 00000100:00100000:3.0:1788836258.215625:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518538624 00000100:00100000:3.0:1788836258.215683:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788836258.215693:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+31:10335:x1875730518538624:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836258.215727:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836258.215749:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9096cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a76d expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215820:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215835:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215846:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215871:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215878:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.215885:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216008:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216034:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216041:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836258.216052:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788836258.216141:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216148:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216155:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216162:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836258.216166:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216174:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216185:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836258.216188:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836258.216192:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216198:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9096d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216211:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216222:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216228:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216233:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836258.216236:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216242:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216249:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0452e2f00) 00010000:00010000:3.0:1788836258.216252:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836258.216254:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216259:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216300:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9096cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 34 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216315:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 33 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.216322:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836258.216325:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836258.216334:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836258.216458:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+33:10335:x1875730518538624:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 765us (942us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788836258.216465:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788836258.219177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836258.219440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518538752 00000100:00100000:2.0:1788836258.219557:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518538752 00000100:00100000:2.0:1788836258.219836:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788836258.219846:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:10335:x1875730518538752:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788836258.219912:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219935:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219947:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219972:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219978:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219985:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.219990:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836258.219994:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.220000:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.220024:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:2.0:1788836258.220026:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836258.220030:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.220036:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b9096ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836258.220103:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:10335:x1875730518538752:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 259us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836258.220109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788836258.221880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.221948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518539008 00000100:00100000:3.0:1788836258.221958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518539008 00000100:00100000:3.0:1788836258.222003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836258.222012:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:10335:x1875730518539008:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788836258.222332:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+34:10335:x1875730518539008:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 320us (458us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788836258.222340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00010000:00010000:1.0:1788836258.576509:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836258.605094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.605202:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518539264 00000100:00100000:3.0:1788836258.605213:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518539264 00000100:00100000:3.0:1788836258.605281:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788836258.605291:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+34:10366:x1875730518539264:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788836258.605315:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836258.605334:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9096f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a774 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.605455:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.605469:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.605482:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836258.605493:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788836258.605649:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9096f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a774 expref: 37 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.605667:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a774 expref: 36 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.605676:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836258.605679:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836258.605696:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d000, rc 0) 00000100:00100000:3.0:1788836258.605761:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+36:10366:x1875730518539264:12345-192.168.203.52@tcp:101:cat.0 Request processed in 471us (678us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788836258.605768:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788836258.611486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836258.611567:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518539520 00000100:00100000:1.0:1788836258.611578:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518539520 00000100:00100000:1.0:1788836258.611644:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788836258.611656:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+36:10366:x1875730518539520:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1788836258.611917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+37:10366:x1875730518539520:12345-192.168.203.52@tcp:35:cat.0 Request processed in 263us (438us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788836258.611934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836258.617365:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.617429:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518539648 00000100:00100000:3.0:1788836258.617438:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518539648 00000100:00100000:3.0:1788836258.617548:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788836258.617559:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047943c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+37:2353:x1875730518539648:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836258.617575:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836258.617599:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b9096fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a774 expref: 37 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.617618:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836258.617623:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836258.617686:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047943c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+36:2353:x1875730518539648:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 123us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836258.617694:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1788836258.675792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836258.675891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518539904 00000100:00100000:1.0:1788836258.675900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518539904 00000100:00100000:1.0:1788836258.676044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1788836258.676056:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+36:10372:x1875730518539904:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788836258.676084:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836258.676088:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836258.676113:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a74a expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676150:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836258.676155:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836258.676170:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90970b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a77b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676261:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676274:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 36 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676282:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676316:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 36 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.676330:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 36 pid: 8192 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836258.676398:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538491520:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836258.676483:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836258.681301:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538491520:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836258.681334:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836258.684896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.689097:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518540032 00000100:00100000:3.0:1788836258.689113:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518540032 00010000:00010000:3.0:1788836258.689176:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 37 pid: 8192 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836258.689230:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788836258.689240:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+37:2354:x1875730518540032:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836258.689256:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836258.689264:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 37 pid: 8192 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.689278:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 37 pid: 8192 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.689304:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b9096e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a76d expref: 37 pid: 8192 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.689320:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836258.689327:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.689336:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.689532:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836258.689694:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836258.689766:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+36:2354:x1875730518540032:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 527us (4879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836258.689776:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:1.0:1788836258.689955:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.689972:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836258.689993:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788836258.690157:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b90970b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.690175:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.690183:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836258.690186:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836258.690188:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376c00, rc 0) 00000100:00100000:1.0:1788836258.690224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+36:10372:x1875730518539904:12345-192.168.203.52@tcp:101:dd.0 Request processed in 14161us (14432us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788836258.690232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788836258.693128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836258.693182:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518540288 00000100:00100000:3.0:1788836258.693192:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518540288 00000100:00100000:3.0:1788836258.693254:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788836258.693264:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+36:10372:x1875730518540288:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:3.0:1788836258.693539:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.693557:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836258.693569:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836258.693619:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788836258.693643:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b5699fe reply state 0000000079660ce5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836258.693652:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836258.702400:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+39:10372:x1875730518540288:12345-192.168.203.52@tcp:36:dd.0 Request processed in 9125us (9268us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788836258.702413:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000020:00080000:0.0:1788836258.702421:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788836258.716739:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716758:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716767:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716773:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836258.716779:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716813:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716830:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836258.716833:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836258.716837:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.716843:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909720 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836258.998752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836258.998855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518540416 00000100:00100000:1.0:1788836258.998866:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518540416 00000100:00100000:1.0:1788836258.998934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788836258.998945:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+38:10386:x1875730518540416:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788836258.998969:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836258.998989:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909727 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a782 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999052:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999066:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999078:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999092:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999124:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999218:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999229:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999238:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999269:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836258.999280:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 39 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836258.999293:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538491648:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836258.999498:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049719180 going to sleep for 11 seconds 00000100:00100000:2.0:1788836259.008899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.009004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518540672 00000100:00100000:0.0:1788836259.009013:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518540672 00000100:00100000:0.0:1788836259.009080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836259.009090:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+40:5589:x1875730518540672:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788836259.009414:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+41:5589:x1875730518540672:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 325us (524us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788836259.009434:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00080000:3.0:1788836259.009505:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836259.009889:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538491648:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836259.009917:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836259.014052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.014996:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518540800 00000100:00100000:0.0:1788836259.015009:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518540800 00010000:00010000:0.0:1788836259.015055:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 41 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.015100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836259.015110:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+41:2354:x1875730518540800:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836259.015126:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836259.015133:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 41 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015147:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 41 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015169:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909712 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a77b expref: 41 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015187:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.015192:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015201:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015209:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.015267:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836259.015327:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+40:2354:x1875730518540800:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 218us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836259.015334:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:1.0:1788836259.015444:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015458:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836259.015498:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788836259.015503:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836259.015544:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015558:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015566:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015573:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015580:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015586:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.015590:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015597:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015607:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836259.015609:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.015613:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015629:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90972e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015642:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015648:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015655:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015660:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.015663:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015668:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015676:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955600) 00010000:00010000:1.0:1788836259.015679:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.015681:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015699:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015734:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909727 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a782 expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015746:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a782 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.015758:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.015761:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836259.015763:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a800, rc 0) 00000100:00100000:1.0:1788836259.015788:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+39:10386:x1875730518540416:12345-192.168.203.52@tcp:101:stat.0 Request processed in 16846us (17047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.015794:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788836259.096965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.097094:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518541056 00000100:00100000:0.0:1788836259.097106:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518541056 00000100:00100000:0.0:1788836259.097173:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788836259.097183:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+39:10392:x1875730518541056:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:0.0:1788836259.097253:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836259.097281:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90973c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a782 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.097300:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.097305:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836259.097588:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.097603:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.097614:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836259.097686:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788836259.097709:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cede899 reply state 00000000c0dc404f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.097717:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836259.097828:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+41:10392:x1875730518541056:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 646us (876us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788836259.097835:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000020:00080000:0.0:1788836259.097839:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788836259.104125:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104161:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104170:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104185:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.104191:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104201:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104639:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.104642:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.104741:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.104751:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909743 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836259.205498:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:3.0:1788836259.205567:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788836259.205598:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd0479c0000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788836259.205604:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd042cfa900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0479c0900 00000020:00080000:3.0:1788836259.205608:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd042cfa400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07b166400 00000100:00100000:3.0:1788836259.205764:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538491776:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788836259.205796:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1788836259.205849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788836259.205954:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788836259.206006:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538491776 00000100:00100000:2.0:1788836259.206017:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538491776 00000100:00080000:3.0:1788836259.206071:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836259.206126:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836259.206138:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538491776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788836259.206244:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788836259.206290:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f79a0, atime: 0x6a9f79a0, ctime: 0x6a9f79a0, blocks: 0x1 00010000:00010000:2.0:1788836259.206300:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836259.206379:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1788836259.206385:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836259.206393:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836259.206413:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836259.206425:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836259.206433:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836259.206459:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836259.207006:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836259.207017:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.207029:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836259.207042:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.207054:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836259.207064:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538491776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 926us (1212us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788836259.207075:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788836259.207080:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.207090:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90974a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836259.207107:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07a727480/2, rc 0, transno 4294967301 00010000:00010000:3.0:1788836259.207117:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836259.207117:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538491776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788836259.207121:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836259.207126:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836259.351730:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836259.351945:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518541184 00000100:00100000:1.0:1788836259.351958:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518541184 00000100:00100000:1.0:1788836259.352232:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788836259.352245:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+10:10406:x1875730518541184:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788836259.352278:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836259.352307:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a789 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.352443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.352461:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.352475:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.352492:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.352500:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.353663:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354656:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354740:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354806:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836259.354878:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788836259.354884:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836259.354935:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354952:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354963:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354971:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354979:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.354986:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978aa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.355002:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355012:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355029:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836259.355033:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.355039:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355076:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355083:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355089:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355094:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.355098:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355105:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355114:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955600) 00010000:00010000:1.0:1788836259.355117:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.355120:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355127:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b90975f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355178:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355195:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.355209:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.355223:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836259.355226:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ac00, rc 0) 00000100:00100000:1.0:1788836259.355484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+11:10406:x1875730518541184:12345-192.168.203.52@tcp:101:stat.0 Request processed in 3239us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.355495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788836259.466456:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.468841:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518541440 00000100:00100000:0.0:1788836259.468861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518541440 00000100:00100000:0.0:1788836259.469262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788836259.469275:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+11:10416:x1875730518541440:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836259.469303:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836259.469330:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b90976d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a790 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836259.469497:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788836259.469844:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b90976d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a790 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.469862:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:0.0:1788836259.469865:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836259.469871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b90976d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a790 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.469889:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820db200, rc 0) 00000100:00100000:0.0:1788836259.470698:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+12:10416:x1875730518541440:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1420us (4249us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788836259.470730:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788836259.482576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.483300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518541696 00000100:00100000:0.0:1788836259.483315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518541696 00000100:00100000:0.0:1788836259.483475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788836259.483489:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+12:10416:x1875730518541696:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836259.484256:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+13:10416:x1875730518541696:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 766us (1689us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788836259.484267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836259.552541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836259.554048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518541952 00000100:00100000:1.0:1788836259.554068:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518541952 00000100:00100000:1.0:1788836259.554227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788836259.554241:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+13:10422:x1875730518541952:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836259.554275:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836259.554303:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90977b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a797 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.554452:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.554469:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.554479:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.554519:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.554558:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 14 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836259.554574:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043070a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538491904:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836259.554790:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836259.560375:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043070a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538491904:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836259.560425:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836259.565177:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836259.565464:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518542080 00000100:00100000:3.0:1788836259.565474:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518542080 00010000:00010000:3.0:1788836259.565516:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 15 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836259.565558:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788836259.565569:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+15:2354:x1875730518542080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836259.565582:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836259.565589:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 15 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565602:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 15 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565639:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a789 expref: 15 pid: 5831 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565658:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836259.565662:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565671:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565678:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836259.565713:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836259.565775:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:2354:x1875730518542080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 208us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836259.565783:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00010000:00010000:1.0:1788836259.568479:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.568495:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836259.568517:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788836259.568694:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90977b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.568712:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.568719:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.568722:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836259.568724:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b600, rc 0) 00000100:00100000:1.0:1788836259.568798:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:10422:x1875730518541952:12345-192.168.203.52@tcp:101:bash.0 Request processed in 14560us (16272us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788836259.568820:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788836259.574950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.575099:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518542336 00000100:00100000:0.0:1788836259.575113:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518542336 00000100:00100000:0.0:1788836259.575785:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788836259.575802:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+14:10422:x1875730518542336:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1788836259.578645:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.579510:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.579534:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836259.579812:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788836259.579877:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0add46e reply state 00000000db265f10 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.579889:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836259.581174:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+17:10422:x1875730518542336:12345-192.168.203.52@tcp:36:bash.0 Request processed in 5365us (6227us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788836259.583618:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000020:00080000:0.0:1788836259.583630:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788836259.587946:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.587971:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.587981:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.588236:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836259.588243:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.588254:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.588285:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.588289:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836259.588295:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.588303:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836259.591708:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836259.591777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518542464 00000100:00100000:1.0:1788836259.591790:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518542464 00000100:00100000:1.0:1788836259.591864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788836259.591876:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+16:10422:x1875730518542464:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836259.591909:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836259.591964:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909797 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a79e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.592077:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.592095:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.592104:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.592148:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.592166:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 17 pid: 5830 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836259.592183:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043070a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538492032:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836259.592300:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836259.596893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.597707:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518542592 00000100:00100000:0.0:1788836259.597720:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518542592 00000100:00100000:1.0:1788836259.597778:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043070a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538492032:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836259.597792:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 18 pid: 5830 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.597815:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.597850:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788836259.597862:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+18:2353:x1875730518542592:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836259.597886:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836259.597895:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 18 pid: 5830 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.597910:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 18 pid: 5830 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.597948:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909782 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a797 expref: 18 pid: 5830 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.597965:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.597970:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.597980:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.597989:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.598050:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836259.598094:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.598104:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.598123:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+17:2353:x1875730518542592:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 261us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836259.598130:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000004:00200000:1.0:1788836259.598179:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788836259.598185:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836259.598212:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.598248:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909797 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a79e expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.598266:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a79e expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.598275:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.598279:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836259.598281:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836259.598313:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+16:10422:x1875730518542464:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6440us (6621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.598320:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:1.0:1788836259.600624:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836259.600996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836259.601101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518542848 00000100:00100000:1.0:1788836259.601113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518542848 00000100:00100000:1.0:1788836259.601180:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788836259.601191:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:10422:x1875730518542848:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836259.601502:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+17:10422:x1875730518542848:12345-192.168.203.52@tcp:35:bash.0 Request processed in 312us (525us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788836259.601511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788836259.665864:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836259.665897:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538492160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836259.666003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836259.666164:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492160 00000100:00100000:1.0:1788836259.666197:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492160 00000100:00100000:1.0:1788836259.666261:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788836259.666273:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538492160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836259.666320:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836259.666408:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538492160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.666416:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836259.666601:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538492160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836259.667811:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836259.673265:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538492416:0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.673889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836259.673972:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538492288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.674007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836259.674210:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538492544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.674245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836259.674266:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836259.674272:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538492672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.674298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836259.674413:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836259.674422:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538492800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.674452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836259.674511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492416 00000100:00100000:2.0:1788836259.674520:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492416 00000100:00100000:2.0:1788836259.674570:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492544 00000100:00100000:2.0:1788836259.674574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492544 00000100:00100000:2.0:1788836259.674604:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492672 00000100:00100000:2.0:1788836259.674607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492672 00000100:00100000:2.0:1788836259.674627:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788836259.674637:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.674978:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492800 00000100:00100000:3.0:1788836259.674983:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492800 00000100:00100000:3.0:1788836259.675022:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836259.675030:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538492800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.675078:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538492800:12345-0@lo:400:kworker.0 Request processed in 48us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836259.675085:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836259.675152:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538492416:12345-0@lo:400:kworker.0 Request processed in 515us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836259.675159:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788836259.675175:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788836259.675182:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538492544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.675226:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538492544:12345-0@lo:400:kworker.0 Request processed in 44us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836259.675233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788836259.675247:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788836259.675254:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538492672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.675280:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538492672:12345-0@lo:400:kworker.0 Request processed in 27us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836259.675298:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788836259.675317:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836259.675323:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836259.675382:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538492800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.675397:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.675482:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538492672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836259.675509:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538492544:0@lo:400:kworker.0 00000100:00100000:1.0:1788836259.675792:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538492288 00000100:00100000:1.0:1788836259.675798:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538492288 00000100:00100000:1.0:1788836259.675844:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788836259.675853:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538492288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836259.675916:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538492288:12345-0@lo:400:kworker.0 Request processed in 65us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.675934:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788836259.676137:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538492288:0@lo:400:kworker.0 00000100:00100000:2.0:1788836259.703911:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.704056:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518543104 00000100:00100000:0.0:1788836259.704070:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518543104 00000100:00100000:0.0:1788836259.704150:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788836259.704163:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:10432:x1875730518543104:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836259.704199:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836259.704227:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836259.704399:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788836259.704560:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7a5 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.704580:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:0.0:1788836259.704584:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836259.704589:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7a5 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.704609:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dae00, rc 0) 00000100:00100000:0.0:1788836259.704674:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:10432:x1875730518543104:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 515us (779us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788836259.704695:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788836259.712589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.712711:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518543232 00000100:00100000:0.0:1788836259.712741:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518543232 00000100:00100000:0.0:1788836259.712824:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788836259.712836:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:10432:x1875730518543232:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788836259.712950:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.712973:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.712989:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713010:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713018:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713025:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713426:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713437:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713445:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836259.713511:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713539:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713546:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713555:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713561:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.713566:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713574:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713589:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836259.713593:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836259.713598:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713604:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713621:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713628:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713634:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713645:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.713649:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713655:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713664:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0498ed300) 00010000:00010000:0.0:1788836259.713666:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836259.713669:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713674:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713691:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713697:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713703:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713708:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.713711:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713716:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713735:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.713737:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836259.713741:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.713747:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.713849:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:10432:x1875730518543232:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1013us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836259.713859:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1788836259.731657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836259.736942:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518543488 00000100:00100000:1.0:1788836259.736963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518543488 00000100:00100000:1.0:1788836259.737113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788836259.737127:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:10432:x1875730518543488:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836259.737499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:10432:x1875730518543488:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 374us (5855us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788836259.737509:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788836259.796023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.796135:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518543744 00000100:00100000:0.0:1788836259.796148:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518543744 00000100:00100000:0.0:1788836259.796228:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1788836259.796239:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+19:10435:x1875730518543744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836259.796273:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836259.796311:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7ac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796439:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796456:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796471:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796489:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796506:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796514:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796943:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9097dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796955:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9097dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.796964:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9097dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836259.796975:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788836259.797089:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797098:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797105:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797112:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.797117:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797125:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797152:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836259.797156:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836259.797161:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797168:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b9097cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797183:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797190:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797196:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797201:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.797203:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797210:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797217:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0498ed300) 00010000:00010000:0.0:1788836259.797220:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836259.797222:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797228:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b9097d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797290:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b9097c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ac expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797304:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9097dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ac expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.797312:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.797314:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836259.797317:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836259.797461:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:10435:x1875730518543744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1223us (1452us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788836259.797469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788836259.801514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.801563:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518543872 00000100:00100000:0.0:1788836259.801576:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518543872 00000100:00100000:0.0:1788836259.801664:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788836259.801685:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:10435:x1875730518543872:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788836259.801781:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801805:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801820:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801854:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801884:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801891:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801898:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836259.801904:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801927:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801945:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836259.801948:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836259.801954:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836259.801961:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836259.802054:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:10435:x1875730518543872:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 380us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836259.802062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1788836259.804754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836259.808391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836259.808496:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518544256 00000100:00100000:0.0:1788836259.808510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518544256 00000100:00100000:0.0:1788836259.808578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788836259.808590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:10435:x1875730518544256:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836259.809523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:10435:x1875730518544256:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 931us (1182us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788836259.809548:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788836259.817061:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518544000 00000100:00100000:1.0:1788836259.817080:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518544000 00000100:00100000:1.0:1788836259.817188:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788836259.817199:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+22:2356:x1875730518544000:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836259.817990:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836259.818049:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b9097dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ac expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836259.818078:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836259.818084:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836259.818171:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+21:2356:x1875730518544000:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 973us (13429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836259.818183:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836260.002904:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.003225:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518544512 00000100:00100000:0.0:1788836260.003238:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518544512 00000100:00100000:0.0:1788836260.003418:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788836260.003431:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:10453:x1875730518544512:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788836260.003465:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836260.003495:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.003628:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9097f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.003646:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9097f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.004116:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9097f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836260.004150:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788836260.004548:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9097f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7b3 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.004574:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9097f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7b3 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.005099:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:0.0:1788836260.005103:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788836260.005107:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376e00, rc 0) 00000100:00100000:0.0:1788836260.005604:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10453:x1875730518544512:12345-192.168.203.52@tcp:101:cat.0 Request processed in 2171us (2710us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788836260.005615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788836260.035436:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.035600:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518544640 00000100:00100000:0.0:1788836260.035612:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518544640 00000100:00100000:0.0:1788836260.036001:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788836260.036015:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:10454:x1875730518544640:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836260.036102:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836260.036128:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7ba expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.036944:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.036965:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.036980:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836260.037025:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788836260.037029:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836260.038302:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.038988:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ba expref: 25 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.039018:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ba expref: 24 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.039822:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836260.039825:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836260.039830:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377c00, rc 0) 00000100:00100000:0.0:1788836260.039939:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+24:10454:x1875730518544640:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3923us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.039949:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788836260.054109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.054489:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545024 00000100:00100000:1.0:1788836260.054504:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545024 00000100:00100000:1.0:1788836260.054956:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788836260.054970:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:10454:x1875730518545024:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836260.055427:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+25:10454:x1875730518545024:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 458us (1394us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788836260.055436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788836260.057986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.058146:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545152 00000100:00100000:3.0:1788836260.058236:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545152 00000100:00100000:3.0:1788836260.058477:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788836260.058490:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+25:10454:x1875730518545152:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1788836260.058511:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788836260.058544:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90979e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a79e expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.058570:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b9097f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7b3 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.058584:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b9096a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a75f expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.058595:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836260.058608:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836260.059631:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:10454:x1875730518545152:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 1134us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.059642:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788836260.066841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.067274:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545280 00000100:00100000:1.0:1788836260.067288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545280 00000100:00100000:1.0:1788836260.067616:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1788836260.067628:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:10454:x1875730518545280:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1788836260.067825:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.067846:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.067860:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836260.068962:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836260.069775:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788836260.069867:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788836260.070896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:10454:x1875730518545280:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 3256us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836260.070911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1788836260.102597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836260.102792:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545408 00000100:00100000:2.0:1788836260.102806:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545408 00000100:00100000:2.0:1788836260.102884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788836260.102897:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:10456:x1875730518545408:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836260.102940:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836260.102969:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90981c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7c1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.103334:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.105201:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.105224:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.105267:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.105275:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.105283:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.108257:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.108290:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.108306:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836260.108994:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788836260.109001:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836260.109030:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109832:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109876:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109882:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109890:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109896:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836260.109901:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109909:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109939:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:2.0:1788836260.109942:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836260.109947:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109954:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109976:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109982:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109987:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.109999:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836260.110002:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110008:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110016:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd04940ba00) 00010000:00010000:2.0:1788836260.110018:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836260.110021:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110026:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90982a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110103:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90981c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110119:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.110127:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:2.0:1788836260.110129:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836260.110132:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999800, rc 0) 00000100:00100000:2.0:1788836260.112029:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:10456:x1875730518545408:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 9121us (9435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836260.112050:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000040:00080000:0.0:1788836260.119965:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836260.119978:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836260.120068:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788836260.120077:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836260.120279:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538492928:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836260.130600:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836260.136339:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538492928:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788836260.147769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.148442:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545536 00000100:00100000:1.0:1788836260.148465:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545536 00000100:00100000:1.0:1788836260.148543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836260.148555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545536:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788836260.149182:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545536:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 626us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836260.149193:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788836260.156291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836260.156634:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545664 00000100:00100000:2.0:1788836260.156688:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545664 00000100:00100000:2.0:1788836260.156764:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788836260.156776:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545664:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836260.156842:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836260.157003:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545664:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 229us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836260.157011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788836260.172978:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.173549:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518545792 00000100:00100000:0.0:1788836260.173564:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518545792 00000100:00100000:0.0:1788836260.173698:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788836260.173710:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545792:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836260.173809:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.173828:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.173842:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174035:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174060:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174074:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174113:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174122:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174129:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836260.174174:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788836260.174178:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836260.174192:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174204:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174210:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174217:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174246:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836260.174251:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174259:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174272:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:0.0:1788836260.174275:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836260.174280:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174286:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909838 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174303:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174309:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174315:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174320:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836260.174322:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174328:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174416:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bd0498ed300) 00010000:00010000:0.0:1788836260.174420:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836260.174424:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174430:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90983f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174449:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174455:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174462:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174467:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836260.174470:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174476:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174485:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:0.0:1788836260.174487:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836260.174491:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.174497:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.174613:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518545792:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 901us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.174624:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788836260.176980:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836260.177085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836260.177333:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538493056 00000100:00100000:2.0:1788836260.177364:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538493056 00000100:00100000:2.0:1788836260.177426:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836260.177438:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538493056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836260.177486:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836260.177543:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538493056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836260.177551:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836260.182377:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836260.190774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836260.191613:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518546048 00000100:00100000:2.0:1788836260.191632:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518546048 00000100:00100000:2.0:1788836260.191720:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788836260.191734:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:10459:x1875730518546048:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836260.191761:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836260.191788:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90984d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7c8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.191946:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.191999:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192016:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836260.192031:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788836260.192165:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192174:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192182:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192190:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836260.192195:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192204:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192220:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:2.0:1788836260.192223:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836260.192230:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192237:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192293:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90984d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c8 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192312:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:2.0:1788836260.192314:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836260.192319:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90984d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c8 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.192330:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998800, rc 0) 00000100:00100000:2.0:1788836260.192433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546048:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 702us (1669us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788836260.192441:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:1.0:1788836260.204673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836260.204767:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518546176 00000100:00100000:2.0:1788836260.204780:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518546176 00000100:00100000:2.0:1788836260.204860:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788836260.204873:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546176:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836260.204933:0:5829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836260.205076:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546176:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 205us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836260.205085:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788836260.215729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.216008:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518546432 00000100:00100000:0.0:1788836260.216017:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518546432 00000100:00100000:0.0:1788836260.216078:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1788836260.216088:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836260.216109:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836260.216113:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788836260.216143:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90980e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7ba expref: 24 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.216164:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836260.216170:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836260.216185:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836260.217649:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788836260.217959:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.217976:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.217988:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.218066:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7cf expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.218085:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7cf expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.218093:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498ed300) 00010000:00010000:0.0:1788836260.218096:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836260.218099:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376e00, rc 0) 00000100:00100000:0.0:1788836260.218178:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:10459:x1875730518546432:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2090us (2458us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788836260.218187:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1788836260.221974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.222078:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518546688 00000100:00100000:3.0:1788836260.222089:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518546688 00000100:00100000:3.0:1788836260.222152:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1788836260.222162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+25:10459:x1875730518546688:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836260.222234:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836260.222266:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7cf expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222286:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498ed300) 00010000:00010000:3.0:1788836260.222296:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836260.222317:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222333:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222366:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222382:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222389:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222407:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222611:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222619:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222626:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222631:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836260.222635:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222641:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222650:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836260.222652:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836260.222656:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222662:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909877 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222670:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222676:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222687:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222692:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836260.222695:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222701:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222708:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xffb21cb7 (ffff9bd0452e2f00) 00010000:00010000:3.0:1788836260.222711:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836260.222713:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.222719:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90987e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xffb21cb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.222807:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546688:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 646us (843us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836260.222814:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:1.0:1788836260.226546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.226629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518546816 00000100:00100000:0.0:1788836260.226638:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518546816 00000100:00100000:0.0:1788836260.226858:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1788836260.226868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+24:10459:x1875730518546816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836260.226888:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836260.226908:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909885 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7d6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.226954:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.226967:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.226977:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.227070:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b909885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.227086:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.227093:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:0.0:1788836260.227096:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836260.227099:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060377c00, rc 0) 00000100:00100000:0.0:1788836260.231017:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+25:10459:x1875730518546816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4134us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.231029:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788836260.240333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.240447:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547072 00000100:00100000:0.0:1788836260.240457:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547072 00000100:00100000:0.0:1788836260.240517:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1788836260.240528:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+25:10459:x1875730518547072:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836260.240641:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.240659:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.240670:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836260.241011:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788836260.241023:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313375679301ns, next at 314375676620ns, rc = 0 00000004:00010000:0.0:1788836260.241118:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000096fada7 reply state 00000000098adcef transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.241127:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836260.241222:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+27:10459:x1875730518547072:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 695us (898us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788836260.241230:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:1.0:1788836260.243377:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243396:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243403:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243427:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836260.243432:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243440:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243456:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:1.0:1788836260.243459:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788836260.243464:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.243471:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909893 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.246624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.246753:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547200 00000100:00100000:1.0:1788836260.246762:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547200 00000100:00100000:1.0:1788836260.246825:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1788836260.246835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:10459:x1875730518547200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836260.246859:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836260.246880:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7dd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.246950:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.246966:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.247001:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:1.0:1788836260.247005:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836260.247009:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a000, rc 0) 00000100:00100000:1.0:1788836260.247075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:10459:x1875730518547200:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 241us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836260.247082:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1788836260.250718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.250798:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547328 00000100:00100000:0.0:1788836260.250808:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547328 00000100:00100000:0.0:1788836260.250850:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788836260.250858:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875730518547328:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788836260.250888:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:0.0:1788836260.250927:0:6681:0:(genops.c:1385:class_connect()) connect: client 539937c3-f568-41e1-b7b5-fe9413243b52, cookie 0xcb5b7bc40b9098a1 00002000:00100000:0.0:1788836260.250939:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 539937c3-f568-41e1-b7b5-fe9413243b52/ffff9bd079849000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788836260.250949:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788836260.251223:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788836260.251259:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bd07984a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836260.251334:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:2352:x1875730518547328:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 Request processed in 475us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.251371:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788836260.254166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.254291:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547456 00000100:00100000:0.0:1788836260.254300:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547456 00000100:00100000:0.0:1788836260.254387:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788836260.254397:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:0:x1875730518547456:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788836260.255160:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836260.296762:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:0:x1875730518547456:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 42357us (42596us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788836260.296786:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000001:00080000:3.0:1788836260.297279:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788836260.297289:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000100:00100000:3.0:1788836260.300567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.300722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547712 00000100:00100000:1.0:1788836260.300733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547712 00000100:00100000:1.0:1788836260.300786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788836260.300792:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788836260.300796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:10459:x1875730518547712:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836260.300800:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788836260.301052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:10459:x1875730518547712:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 256us (492us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788836260.301060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836260.308809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.309790:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518547968 00000100:00100000:1.0:1788836260.309801:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518547968 00000100:00100000:1.0:1788836260.309850:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1788836260.309859:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+28:10459:x1875730518547968:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836260.309986:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+28:10459:x1875730518547968:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 127us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836260.309993:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788836260.316742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.317002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548096 00000100:00100000:1.0:1788836260.317014:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548096 00000100:00100000:1.0:1788836260.317071:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788836260.317080:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:10459:x1875730518548096:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836260.317113:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836260.317134:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b9098a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7e4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317200:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317502:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317513:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836260.317548:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836260.317566:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317593:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b9098a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7e4 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317609:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7e4 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.317618:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:1.0:1788836260.317620:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836260.317623:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a200, rc 0) 00000100:00100000:1.0:1788836260.317749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:10459:x1875730518548096:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 669us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836260.317757:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788836260.320295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.323108:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548224 00000100:00100000:3.0:1788836260.323121:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548224 00000100:00100000:3.0:1788836260.323223:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836260.323234:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518548224:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836260.323253:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836260.323272:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7eb expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836260.323298:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f79a2, blocks: 0x1 00010000:00010000:3.0:1788836260.323316:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1788836260.323321:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.323329:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.323369:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.323384:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836260.323444:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518548224:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 212us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.323451:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836260.327623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.334911:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548480 00000100:00100000:0.0:1788836260.334937:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548480 00000100:00100000:0.0:1788836260.335030:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:0.0:1788836260.335041:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:10459:x1875730518548480:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788836260.335148:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:10459:x1875730518548480:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 109us (7533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.335156:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1788836260.337933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.337966:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548608 00000100:00100000:3.0:1788836260.337975:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548608 00000100:00100000:3.0:1788836260.338020:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788836260.338042:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:10459:x1875730518548608:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836260.340658:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836260.340688:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7f2 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.340730:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.340740:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.340744:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.340749:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.340788:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.340818:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.340834:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538493184:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836260.340993:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836260.358429:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538493184:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836260.358544:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.358587:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836260.358650:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:10459:x1875730518548608:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 20608us (20735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.358659:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788836260.358843:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.359181:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548736 00000100:00100000:3.0:1788836260.359188:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548736 00010000:00010000:3.0:1788836260.359221:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.359266:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788836260.359276:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047941050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518548736:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836260.359290:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836260.359313:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.359327:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.359543:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7eb expref: 7 pid: 6680 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.359560:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.359564:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.359573:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.359591:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.359627:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.359641:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875730538493312:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788836260.359711:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836260.363540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.363597:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875730538493312:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788836260.363622:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836260.363639:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548864 00000100:00100000:1.0:1788836260.363645:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548864 00000100:00100000:3.0:1788836260.363687:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047941050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518548736:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4413us (4846us total) trans 0 rc 0/0 00002000:00100000:1.0:1788836260.363687:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bd07a3ddf80 x1875730518548864/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:426/0 lens 504/0 e 0 to 0 dl 1788836271 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836260.363696:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07a3ddf80 with x1875730518548864 ext(0->8) 00000100:00100000:3.0:1788836260.363697:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00002000:00010000:1.0:1788836260.363700:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07a3ddf80 00000100:00100000:1.0:1788836260.363728:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836260.363737:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518548864:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788836260.364747:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518548864:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 1006us (1211us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788836260.364758:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:1.0:1788836260.364767:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bd07a3ddf80 x1875730518548864/t4294967302(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:426/0 lens 504/448 e 0 to 0 dl 1788836271 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836260.364776:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07a3ddf80 with x1875730518548864 ext(0->8) 00002000:00010000:1.0:1788836260.364781:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07a3ddf80 00000100:00100000:2.0:1788836260.367428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.367522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518548992 00000100:00100000:0.0:1788836260.367533:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518548992 00000100:00100000:0.0:1788836260.367588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788836260.367598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+29:10459:x1875730518548992:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788836260.429224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+29:10459:x1875730518548992:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 61618us (61794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.429242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000001:00080000:3.0:1788836260.429283:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788836260.429291:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788836260.429320:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1788836260.429333:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788836260.431143:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788836260.431158:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788836260.431165:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836260.431182:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538493440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836260.431283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836260.431368:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538493440 00000100:00100000:3.0:1788836260.431375:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538493440 00000100:00100000:3.0:1788836260.431421:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836260.431430:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538493440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788836260.431590:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788836260.431593:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788836258 00002000:00010000:3.0:1788836260.431596:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788836260.431598:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788836258 -> 1788836258 00002000:00010000:3.0:1788836260.431600:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788836260.431635:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875730538493440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (353us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788836260.431642:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788836260.431696:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07ac70e00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788836260.431702:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538493440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788836260.441381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.441611:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518549120 00000100:00100000:3.0:1788836260.441621:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518549120 00000100:00100000:3.0:1788836260.441681:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788836260.441693:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2356:x1875730518549120:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788836260.520428:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2356:x1875730518549120:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 78726us (79078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.520442:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000001:00080000:3.0:1788836260.520483:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788836260.520497:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788836260.523115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.526466:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518549376 00000100:00100000:0.0:1788836260.526481:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518549376 00000100:00100000:1.0:1788836260.526612:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1788836260.526624:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:10459:x1875730518549376:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836260.526676:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836260.526702:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7e4 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.526720:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:1.0:1788836260.526725:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836260.526769:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.526783:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.526794:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836260.527197:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf6d581b reply state 00000000ba1fb227 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836260.528268:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836260.528532:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+14:10459:x1875730518549376:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1905us (5421us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788836260.528540:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00010000:00010000:0.0:1788836260.533062:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533082:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533090:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533096:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836260.533101:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533123:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533140:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:0.0:1788836260.533143:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836260.533149:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.533155:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b9098c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.539177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.539240:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518549504 00000100:00100000:3.0:1788836260.539256:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518549504 00000100:00100000:3.0:1788836260.539309:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1788836260.539318:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518549504:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788836260.539556:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788836260.539559:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788836258 -> 1788836258 00002000:00010000:3.0:1788836260.539562:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788836256 00002000:00010000:3.0:1788836260.539564:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788836258 -> 1788836258 00002000:00010000:3.0:1788836260.539566:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788836260.539695:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518549504:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 377us (522us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788836260.539703:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788836260.553830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.553922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518549760 00000100:00100000:1.0:1788836260.553931:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518549760 00000100:00100000:1.0:1788836260.553987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1788836260.553998:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+13:10459:x1875730518549760:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788836260.554065:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.554082:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.554092:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.554128:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.554155:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 13 pid: 5831 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836260.554170:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043073800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538493568:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836260.554263:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836260.571269:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043073800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538493568:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836260.571299:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.573441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.575808:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518549888 00000100:00100000:3.0:1788836260.575822:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518549888 00010000:00010000:3.0:1788836260.575866:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 14 pid: 5831 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.576552:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836260.576565:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:2353:x1875730518549888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836260.576581:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836260.576590:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 14 pid: 5831 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.576605:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 14 pid: 5831 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.576629:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b90988c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7d6 expref: 14 pid: 5831 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.576658:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:3.0:1788836260.576664:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.577412:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.577423:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.577461:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836260.577522:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+13:2353:x1875730518549888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 959us (4087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.577530:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00010000:00010000:2.0:1788836260.577588:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577596:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577622:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577630:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577636:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577642:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836260.577647:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577654:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577664:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:2.0:1788836260.577667:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788836260.577682:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836260.577689:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836260.577732:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+12:10459:x1875730518549760:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 23735us (23907us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788836260.577752:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1788836260.582209:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.582273:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550016 00000100:00100000:3.0:1788836260.582282:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550016 00000100:00100000:3.0:1788836260.582374:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788836260.582386:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518550016:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788836260.582425:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.582445:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.582454:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836260.582458:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836260.582463:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.582508:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.582521:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 7 pid: 6683 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.582536:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538493696:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836260.582610:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836260.586449:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538493696:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836260.586479:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836260.592016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.595294:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550144 00000100:00100000:3.0:1788836260.595311:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550144 00010000:00010000:3.0:1788836260.595382:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 8 pid: 6683 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.595427:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788836260.595437:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518550144:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836260.595451:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836260.595472:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 8 pid: 6683 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595486:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 8 pid: 6683 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595508:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b9098bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f2 expref: 8 pid: 6683 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595536:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836260.595540:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836260.595546:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595556:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595589:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836260.595648:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518550144:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 213us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.595656:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00010000:00010000:3.0:1788836260.595700:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595709:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595732:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595740:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595747:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595760:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836260.595764:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595772:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595785:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.595792:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052f234da/0xcb5b7bc40b9098d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.595834:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518550016:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 13451us (13632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.595840:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788836260.598684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.598754:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550400 00000100:00100000:0.0:1788836260.598763:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550400 00000100:00100000:0.0:1788836260.598849:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788836260.598859:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+12:10459:x1875730518550400:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788836260.598954:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.598972:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.598983:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.599212:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.599225:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.599233:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.599268:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.599282:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 13 pid: 5830 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.599296:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538493824:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836260.599415:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836260.604464:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad02680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538493824:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836260.604501:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.606261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836260.606516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550528 00000100:00100000:0.0:1788836260.606536:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550528 00010000:00010000:0.0:1788836260.606576:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 14 pid: 5830 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836260.606609:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788836260.606619:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:2354:x1875730518550528:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836260.606654:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836260.606663:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 14 pid: 5830 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606688:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 14 pid: 5830 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606714:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b90989a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7dd expref: 14 pid: 5830 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606730:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:0.0:1788836260.606735:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606749:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606756:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836260.606788:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836260.606838:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+13:2354:x1875730518550528:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 221us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836260.606845:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00010000:00010000:1.0:1788836260.606953:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.606962:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836260.607157:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788836260.607311:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788836260.607390:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788836260.607469:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043073100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538493952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788836260.607516:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836260.607544:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836260.607611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538493952 00000100:00100000:2.0:1788836260.607617:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538493952 00000100:00100000:2.0:1788836260.607652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836260.607661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538493952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788836260.607738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538493952:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836260.607745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836260.607810:0:8192:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788836260.607815:0:8192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07ac70e00, transno 4294967303 00000100:00100000:1.0:1788836260.607828:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043073100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538493952:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788836260.608445:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788836260.608501:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043073100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538494080:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788836260.608535:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836260.608555:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788836260.608616:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538494080 00000100:00100000:2.0:1788836260.608623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538494080 00000100:00100000:2.0:1788836260.608659:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836260.608666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538494080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788836260.608834:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8192:x1875730538494080:12345-0@lo:1000:mdt00_003.0 Request processed in 168us (297us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788836260.608841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836260.609047:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043073100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538494080:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788836260.609078:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609088:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609095:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609101:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836260.609105:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609113:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609130:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd0498edd00) 00010000:00010000:1.0:1788836260.609132:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836260.609136:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609143:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9098e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609179:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609185:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609190:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609204:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836260.609207:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609213:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609223:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:1.0:1788836260.609225:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836260.609227:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609242:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909815 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609263:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609276:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609285:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609310:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.609325:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 16 pid: 5829 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836260.610441:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043070700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538494208:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836260.610530:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836260.619026:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043070700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538494208:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836260.619053:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836260.623323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836260.623450:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550656 00000100:00100000:3.0:1788836260.623460:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550656 00010000:00010000:3.0:1788836260.623552:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 17 pid: 5829 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836260.623595:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788836260.623605:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+17:2354:x1875730518550656:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836260.623633:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836260.623640:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 17 pid: 5829 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623653:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 17 pid: 5829 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623675:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7c1 expref: 17 pid: 5829 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623690:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:3.0:1788836260.623695:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623705:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623712:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.623743:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836260.623782:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623790:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623803:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623809:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623815:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623820:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836260.623824:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623831:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623840:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:1.0:1788836260.623849:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836260.623854:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623860:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623873:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623878:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623883:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623887:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836260.623890:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623895:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623903:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd07a955600) 00010000:00010000:1.0:1788836260.623905:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836260.623908:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.623926:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9098d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836260.624288:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836260.624294:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836260.624320:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788836260.624326:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836260.624366:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+16:2354:x1875730518550656:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 740us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836260.624374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788836260.628465:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+15:10459:x1875730518550400:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 29596us (29784us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788836260.628499:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000020:00080000:1.0:1788836260.628507:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:2.0:1788836260.629328:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836260.631632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836260.631721:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518550912 00000100:00100000:1.0:1788836260.631731:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518550912 00000100:00100000:1.0:1788836260.631852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788836260.631870:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+15:10459:x1875730518550912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788836260.632729:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788836260.632901:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788836260.632970:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.632988:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.633000:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.633009:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.633015:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.633021:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836260.633095:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788836260.633183:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:10459:x1875730518550912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1321us (1558us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788836260.633203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000020:00080000:1.0:1788836260.633208:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836260.633318:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836260.633325:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.633432:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836260.633436:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.633444:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.633456:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd07a955500) 00010000:00010000:3.0:1788836260.633459:0:6696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836260.633463:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.633468:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b9098ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836260.633483:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836260.633485:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836260.633487:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836260.866804:0:11987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836260.866814:0:11987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836260.866847:0:11987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788836260.866854:0:11987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836261.023251:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.024491:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518551168 00000100:00100000:1.0:1788836261.024504:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518551168 00000100:00100000:1.0:1788836261.024574:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:1.0:1788836261.024584:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+17:10477:x1875730518551168:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836261.024606:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836261.024626:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a7f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.024715:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.024730:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.024747:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836261.024757:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788836261.024866:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b9098f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f9 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.024880:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f9 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.024901:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836261.024904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836261.024907:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a200, rc 0) 00000100:00100000:1.0:1788836261.024976:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:10477:x1875730518551168:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 394us (1735us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788836261.024983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00080000:2.0:1788836261.025857:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836261.034214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.034298:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518551296 00000100:00100000:0.0:1788836261.034308:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518551296 00000100:00100000:0.0:1788836261.034383:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788836261.034392:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:10477:x1875730518551296:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788836261.034481:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034497:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034508:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034523:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034530:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034536:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034791:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034799:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034806:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836261.034843:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034856:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034873:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034881:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034887:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836261.034892:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034899:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034923:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836261.034927:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836261.034931:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034938:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b90990a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034950:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034956:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034961:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034966:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836261.034975:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034982:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.034990:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0498ede00) 00010000:00010000:0.0:1788836261.034992:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836261.034995:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035001:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b909911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035017:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035022:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035027:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035032:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836261.035035:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035041:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035048:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0498eda00) 00010000:00010000:0.0:1788836261.035050:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836261.035059:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.035066:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b909918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836261.035147:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:10477:x1875730518551296:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 755us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836261.035154:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1788836261.105504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.105541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518551552 00000100:00100000:3.0:1788836261.105551:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518551552 00000100:00100000:3.0:1788836261.105601:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1788836261.105612:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:10480:x1875730518551552:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836261.105633:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836261.105652:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90991f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a800 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105724:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105745:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105756:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105772:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105779:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.105785:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106248:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106257:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106264:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836261.106274:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788836261.106396:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106404:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106411:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106426:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.106430:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106438:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106452:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836261.106455:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.106460:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106467:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106478:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106484:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106490:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106495:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.106497:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106502:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106521:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0452e2f00) 00010000:00010000:3.0:1788836261.106524:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.106527:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106533:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90992d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90991f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106589:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.106596:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:3.0:1788836261.106598:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836261.106601:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d200, rc 0) 00000100:00100000:3.0:1788836261.106667:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:10480:x1875730518551552:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1057us (1173us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788836261.106675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788836261.119482:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.119575:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518551680 00000100:00100000:2.0:1788836261.119586:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518551680 00000100:00100000:2.0:1788836261.119654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:2.0:1788836261.119666:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:10480:x1875730518551680:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788836261.119735:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119752:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119764:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119789:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119796:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119803:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119809:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.119813:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119821:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119832:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:2.0:1788836261.119835:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836261.119839:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.119855:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.119936:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:10480:x1875730518551680:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 273us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836261.119944:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1788836261.125793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.128683:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518551936 00000100:00100000:2.0:1788836261.128699:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518551936 00000100:00100000:2.0:1788836261.128767:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788836261.128778:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:10480:x1875730518551936:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836261.129045:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:10480:x1875730518551936:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 267us (3260us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788836261.129053:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788836261.174171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.174376:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552192 00000100:00100000:1.0:1788836261.174387:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552192 00000100:00100000:1.0:1788836261.174446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:1.0:1788836261.174457:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:10011:x1875730518552192:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836261.174480:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836261.174501:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909949 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a807 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.174614:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.174629:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.174637:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.174671:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.174702:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 23 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.174715:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043073b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538494336:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836261.174819:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836261.177688:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043073b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538494336:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836261.177722:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.177780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.177852:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552320 00000100:00100000:1.0:1788836261.177868:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552320 00010000:00010000:1.0:1788836261.177900:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 24 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.177949:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788836261.177959:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+24:2353:x1875730518552320:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836261.177974:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836261.177981:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 24 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.177994:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 24 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.178016:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a800 expref: 24 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.178048:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:1.0:1788836261.178053:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.178062:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.178069:0:8494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.178096:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836261.178157:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+23:2353:x1875730518552320:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 198us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.178164:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00010000:00010000:3.0:1788836261.178603:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.178612:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836261.178643:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788836261.178795:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909949 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.178811:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.178819:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:3.0:1788836261.178821:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836261.178824:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b000, rc 0) 00000100:00100000:3.0:1788836261.178884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:10011:x1875730518552192:12345-192.168.203.52@tcp:101:bash.0 Request processed in 4429us (4723us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788836261.178891:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1788836261.183412:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.183504:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552576 00000100:00100000:2.0:1788836261.183515:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552576 00000100:00100000:2.0:1788836261.183562:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:2.0:1788836261.183572:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:10011:x1875730518552576:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788836261.183818:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.183834:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.183845:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836261.183895:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788836261.183945:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0507858 reply state 0000000088403e01 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.183966:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788836261.184016:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788836261.184132:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+27:10011:x1875730518552576:12345-192.168.203.52@tcp:36:bash.0 Request processed in 560us (729us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788836261.184140:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000020:00080000:2.0:1788836261.184145:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788836261.187398:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187415:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187422:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187427:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836261.187432:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187438:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187469:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:1.0:1788836261.187472:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836261.187476:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.187481:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90995e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.187855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.188133:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552704 00000100:00100000:0.0:1788836261.188143:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552704 00000100:00100000:0.0:1788836261.188191:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1788836261.188206:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:10011:x1875730518552704:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836261.188228:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836261.188246:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a80e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.188302:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a80e expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.188317:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a80e expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.188335:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:0.0:1788836261.188338:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836261.188365:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd060376e00, rc 0) 00000100:00100000:0.0:1788836261.188437:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:10011:x1875730518552704:12345-192.168.203.52@tcp:101:bash.0 Request processed in 237us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836261.188454:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1788836261.197395:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.197571:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552832 00000100:00100000:3.0:1788836261.197581:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552832 00000100:00100000:3.0:1788836261.197636:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788836261.197646:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:10011:x1875730518552832:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836261.197676:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836261.197697:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a815 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836261.197724:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f79a2, atime: 0x6a9f79a0, ctime: 0x6a9f79a2, blocks: 0xb 00010000:00010000:3.0:1788836261.197745:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788836261.197751:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836261.197772:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.197791:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.197804:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836261.197867:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:10011:x1875730518552832:12345-192.168.203.52@tcp:101:bash.0 Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836261.197874:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788836261.203989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.204085:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518552960 00000100:00100000:1.0:1788836261.204095:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518552960 00002000:00010000:1.0:1788836261.204140:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788836261.204146:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07a3dfb80 with x1875730518552960 ext(0->18446744073709551615) 00002000:00010000:1.0:1788836261.204158:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07a3dfb80. 00000100:00100000:1.0:1788836261.204190:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836261.204200:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2356:x1875730518552960:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:1.0:1788836261.204505:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788836261.204510:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788836258 -> 1788836259 00002000:00010000:1.0:1788836261.204989:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788836256 -> 1788836256 00002000:00010000:1.0:1788836261.204994:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788836258 -> 1788836259 00002000:00010000:1.0:1788836261.204996:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788836261.205066:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2356:x1875730518552960:12345-192.168.203.52@tcp:10:bash.0 Request processed in 866us (1085us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788836261.205074:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00010000:1.0:1788836261.205078:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788836261.205081:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07a3dfb80 with x1875730518552960 ext(0->18446744073709551615) 00002000:00010000:1.0:1788836261.205086:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07a3dfb80. 00000100:00100000:0.0:1788836261.301426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.301974:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518553088 00000100:00100000:2.0:1788836261.301986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518553088 00000100:00100000:2.0:1788836261.302052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1788836261.302063:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+27:10495:x1875730518553088:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788836261.302145:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302164:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302175:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302191:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302199:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302206:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302512:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302522:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302529:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836261.302570:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302581:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302588:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302594:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302599:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.302603:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302611:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302623:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:2.0:1788836261.302626:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836261.302631:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302643:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302656:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302663:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302668:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302673:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.302677:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302683:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302691:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd04940ba00) 00010000:00010000:2.0:1788836261.302694:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836261.302696:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302702:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90997a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302717:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302723:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302736:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302740:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.302743:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302749:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302757:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:2.0:1788836261.302760:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836261.302762:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.302768:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.302858:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+27:10495:x1875730518553088:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 795us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836261.302866:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1788836261.372446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.372541:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518553344 00000100:00100000:3.0:1788836261.372551:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518553344 00000100:00100000:3.0:1788836261.372614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788836261.372625:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:10498:x1875730518553344:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836261.372643:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836261.372662:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909988 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a81c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372743:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372757:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372769:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372784:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372805:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.372813:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373079:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90999d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373089:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90999d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373096:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90999d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836261.373106:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788836261.373191:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373199:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373206:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373213:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.373217:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373225:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373248:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836261.373251:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.373256:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373263:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90998f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373275:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373282:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373288:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373293:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.373296:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373302:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373309:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0452e2600) 00010000:00010000:3.0:1788836261.373312:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.373315:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373321:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373420:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909988 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a81c expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373435:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90999d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a81c expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.373443:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:3.0:1788836261.373445:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788836261.373448:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d800, rc 0) 00000100:00100000:3.0:1788836261.373519:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:10498:x1875730518553344:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 895us (1081us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788836261.373527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788836261.380400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.380497:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518553472 00000100:00100000:0.0:1788836261.380509:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518553472 00000100:00100000:0.0:1788836261.380581:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:0.0:1788836261.380593:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:10498:x1875730518553472:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788836261.380664:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.380692:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.380702:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.380737:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.380751:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 29 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836261.380766:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538494464:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836261.380876:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836261.389537:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538494464:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836261.389568:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.389953:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.392358:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518553728 00000100:00100000:1.0:1788836261.392372:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518553728 00000100:00100000:1.0:1788836261.392501:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788836261.392511:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+30:5589:x1875730518553728:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836261.392852:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+31:5589:x1875730518553728:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 342us (2900us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788836261.392861:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788836261.399514:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.399609:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518553856 00000100:00100000:0.0:1788836261.399619:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518553856 00010000:00010000:0.0:1788836261.399658:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 31 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836261.399710:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788836261.399720:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+31:2353:x1875730518553856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836261.399734:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836261.399741:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 31 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399755:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 31 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399776:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909950 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a807 expref: 31 pid: 5831 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399791:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:0.0:1788836261.399796:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399805:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399811:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.399843:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836261.399921:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+30:2353:x1875730518553856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 203us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836261.399929:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00010000:00010000:1.0:1788836261.402095:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402114:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402157:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402163:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402170:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402176:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836261.402181:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402188:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402207:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:1.0:1788836261.402210:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836261.402234:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.402241:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.402401:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:10498:x1875730518553472:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 21805us (22007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.402411:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:2.0:1788836261.409474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.409593:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518554112 00000100:00100000:1.0:1788836261.409602:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518554112 00000100:00100000:1.0:1788836261.409708:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788836261.409719:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+29:10498:x1875730518554112:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836261.410120:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+30:10498:x1875730518554112:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 402us (654us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788836261.410129:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788836261.484460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.484825:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518554368 00000100:00100000:3.0:1788836261.484836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518554368 00000100:00100000:3.0:1788836261.484895:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1788836261.484922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+30:10509:x1875730518554368:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788836261.484947:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836261.484967:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9099b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a823 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485183:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485199:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485223:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485237:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485245:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485251:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485591:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b9099c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485601:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b9099c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485608:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b9099c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836261.485619:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788836261.485702:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485710:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485716:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485722:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.485732:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485740:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485752:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836261.485755:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.485759:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485765:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b9099b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485778:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485783:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485788:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485793:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836261.485795:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485800:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485805:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0452e2600) 00010000:00010000:3.0:1788836261.485808:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836261.485815:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485821:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b9099c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485859:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b9099b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a823 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485872:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b9099c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a823 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.485880:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:3.0:1788836261.485882:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836261.485884:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0da00, rc 0) 00000100:00100000:3.0:1788836261.486187:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:10509:x1875730518554368:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1107us (1561us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788836261.486197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:2.0:1788836261.491101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.491239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518554624 00000100:00100000:1.0:1788836261.491250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518554624 00000100:00100000:1.0:1788836261.491321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788836261.491332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:10509:x1875730518554624:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1788836261.491645:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:10509:x1875730518554624:12345-192.168.203.52@tcp:35:cat.0 Request processed in 315us (557us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788836261.491653:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836261.531891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.535471:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518554880 00000100:00100000:0.0:1788836261.535489:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518554880 00000100:00100000:0.0:1788836261.535566:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788836261.535579:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+33:10510:x1875730518554880:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:0.0:1788836261.535644:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788836261.535670:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b9099c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a823 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535694:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90999d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a81c expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376e00/0xcb5b7bc40b909965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a80e expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535883:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0452e2d00) 00010000:00010000:0.0:1788836261.535894:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836261.535924:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535939:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535949:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535981:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535988:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.535995:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.536267:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.536277:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.536284:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836261.538781:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788836261.538794:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314673450181ns, next at 315673447706ns, rc = 0 00010000:00010000:1.0:1788836261.538864:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538891:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538903:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538923:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538930:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538936:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538962:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836261.538982:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538988:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.538995:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539001:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836261.539005:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539012:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539032:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0498ede00) 00010000:00010000:1.0:1788836261.539035:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788836261.539038:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376c00/0xcb5b7bc40b9099e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539061:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539067:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539072:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539077:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836261.539080:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539086:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539092:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836261.539094:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836261.539097:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.539102:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060377c00/0xcb5b7bc40b9099d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836261.539119:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bc28fa9 reply state 000000009646db5b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.539128:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836261.539209:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+32:10510:x1875730518554880:12345-192.168.203.52@tcp:36:rm.0 Request processed in 3629us (7325us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788836261.539217:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00010000:00010000:2.0:1788836261.539433:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836261.539440:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.539447:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978be00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836261.539456:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.539463:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.539472:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd0498ede00) 00010000:00010000:2.0:1788836261.539475:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788836261.539478:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.539483:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b9099ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.539496:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836261.539498:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836261.539499:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836261.548087:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548104:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548111:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548116:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.548121:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548129:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548162:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0498eda00) 00010000:00010000:2.0:1788836261.548165:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836261.548170:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.548177:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376400/0xcb5b7bc40b9099dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.624822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.627479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555136 00000100:00100000:1.0:1788836261.627492:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555136 00000100:00100000:1.0:1788836261.627567:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1788836261.627578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+31:10516:x1875730518555136:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836261.627601:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836261.627621:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b9099f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a82a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627806:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627822:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627833:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627847:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627853:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.627878:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836261.628684:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788836261.629423:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629438:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629449:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629483:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629491:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629498:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629503:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836261.629508:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629515:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629526:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836261.629529:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836261.629541:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629547:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b9099f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836261.629561:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b1f4951 reply state 00000000c61c9a8a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.629569:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788836261.629600:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b9099f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629612:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.629620:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:1.0:1788836261.629622:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836261.629625:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a600, rc 0) 00000100:00100000:1.0:1788836261.629803:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+34:10516:x1875730518555136:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2226us (5504us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788836261.629811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00010000:00010000:2.0:1788836261.643193:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643210:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643218:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643224:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.643229:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643236:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643252:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955600) 00010000:00010000:2.0:1788836261.643254:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836261.643259:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.643265:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b9099ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.647551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.647632:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555264 00000100:00100000:3.0:1788836261.647642:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555264 00000100:00100000:3.0:1788836261.647729:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788836261.647741:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518555264:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836261.647759:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836261.647777:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a831 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836261.647805:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836261.647825:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788836261.647842:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836261.647852:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.647873:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.647888:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d400, rc 0) 00000100:00100000:3.0:1788836261.647960:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518555264:12345-192.168.203.52@tcp:101:bash.0 Request processed in 221us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836261.647966:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00080000:2.0:1788836261.648209:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836261.649479:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836261.665764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.665930:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555392 00000100:00100000:0.0:1788836261.665940:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555392 00000100:00100000:0.0:1788836261.665997:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836261.666008:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:10516:x1875730518555392:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836261.666027:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836261.666047:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a838 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.666080:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.666108:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836261.666112:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836261.666119:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.666152:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.666166:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836261.666181:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538494592:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836261.666284:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836261.670145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.670268:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538494592:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836261.670317:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.670339:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dae00, rc 0) 00000100:00100000:0.0:1788836261.670434:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:10516:x1875730518555392:12345-192.168.203.52@tcp:101:bash.0 Request processed in 4427us (4679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836261.670443:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:1.0:1788836261.670861:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555520 00000100:00100000:1.0:1788836261.670870:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555520 00010000:00010000:1.0:1788836261.670915:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.670953:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788836261.670962:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047940450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+9:2353:x1875730518555520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836261.670991:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836261.671023:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.671038:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.671063:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a89190/0xcb5b7bc40b909a14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a831 expref: 9 pid: 6683 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.671077:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836261.671081:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836261.671089:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.671098:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.671130:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.671143:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875730538494720:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788836261.671213:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836261.674397:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875730538494720:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788836261.674428:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836261.674503:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047940450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518555520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3541us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.674514:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788836261.676917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.676985:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555776 00000100:00100000:1.0:1788836261.676994:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555776 00000100:00100000:1.0:1788836261.677061:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788836261.677072:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+33:10516:x1875730518555776:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836261.677468:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+34:10516:x1875730518555776:12345-192.168.203.52@tcp:35:bash.0 Request processed in 396us (568us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788836261.677475:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788836261.821257:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.822060:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518555904 00000100:00100000:1.0:1788836261.822072:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518555904 00000100:00100000:1.0:1788836261.822146:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:1.0:1788836261.822157:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+34:10532:x1875730518555904:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836261.822179:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836261.822200:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a83f expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822264:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822278:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822289:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836261.822321:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788836261.822325:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836261.822408:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822435:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a83f expref: 36 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822452:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a83f expref: 35 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.822461:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836261.822463:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836261.822467:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a400, rc 0) 00000100:00100000:1.0:1788836261.822543:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+35:10532:x1875730518555904:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 388us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.822550:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1788836261.837807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.837943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556160 00000100:00100000:0.0:1788836261.837957:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556160 00000100:00100000:0.0:1788836261.838023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788836261.838049:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+35:10532:x1875730518556160:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836261.838070:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836261.838093:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909a30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a846 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.838197:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.838213:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.838226:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836261.838238:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788836261.838425:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909a30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a846 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.838445:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a846 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.838454:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:0.0:1788836261.838457:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836261.838461:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836261.838530:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+37:10532:x1875730518556160:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 483us (735us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788836261.838537:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788836261.843872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.843931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.844025:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556544 00000100:00100000:2.0:1788836261.844034:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556544 00000100:00100000:2.0:1788836261.844097:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836261.844107:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+37:2353:x1875730518556544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836261.844122:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836261.844149:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a846 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.844171:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:2.0:1788836261.844176:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836261.844232:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+36:2353:x1875730518556544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836261.844240:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836261.844304:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556416 00000100:00100000:1.0:1788836261.844309:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556416 00000100:00100000:1.0:1788836261.844370:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:1.0:1788836261.844377:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+36:10532:x1875730518556416:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836261.844404:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836261.844418:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a84d expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.844499:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.844512:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.844533:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836261.844545:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788836261.844659:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a84d expref: 39 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.844674:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a84d expref: 38 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.844681:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:1.0:1788836261.844684:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788836261.844687:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836261.844713:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+38:10532:x1875730518556416:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 337us (853us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788836261.844720:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1788836261.863941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.864036:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556672 00000100:00100000:1.0:1788836261.864047:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556672 00000100:00100000:1.0:1788836261.864132:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788836261.864143:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518556672:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:1.0:1788836261.864186:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.864220:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.864230:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836261.864248:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836261.864253:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.864290:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.864304:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 8 pid: 6680 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.864319:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875730538494848:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836261.864436:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836261.868131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836261.868244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556800 00000100:00100000:2.0:1788836261.868253:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556800 00002000:00100000:2.0:1788836261.868300:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bd07ad1dc00 x1875730518556800/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:427/0 lens 504/0 e 0 to 0 dl 1788836272 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836261.868311:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07ad1dc00 with x1875730518556800 ext(0->8) 00010000:00010000:2.0:1788836261.868320:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 9 pid: 6680 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.868383:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 9 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836261.868392:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd07ad1dc00 00000100:00100000:2.0:1788836261.868440:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836261.868449:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518556800:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:1.0:1788836261.868990:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875730538494848:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836261.869013:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.870752:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+11:2354:x1875730518556800:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 2294us (2622us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788836261.870766:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00100000:2.0:1788836261.870779:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bd07ad1dc00 x1875730518556800/t4294967302(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:427/0 lens 504/448 e 0 to 0 dl 1788836272 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836261.870789:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07ad1dc00 with x1875730518556800 ext(0->8) 00010000:00010000:2.0:1788836261.870799:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.870817:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836261.870824:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd07ad1dc00 00000100:00100000:2.0:1788836261.880501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.880668:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518556928 00000100:00100000:3.0:1788836261.880679:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518556928 00010000:00010000:3.0:1788836261.880720:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.880753:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788836261.880763:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+11:2353:x1875730518556928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836261.880779:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788836261.880799:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788836261.880802:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788836260 00002000:00010000:3.0:1788836261.880805:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788836260 00002000:00010000:3.0:1788836261.880806:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788836260 00010000:00010000:3.0:1788836261.880813:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.880833:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.880871:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7425f/0xcb5b7bc40b909a1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a838 expref: 11 pid: 6680 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.880890:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788836261.880895:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836261.880901:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.880920:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.880951:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836261.881010:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:2353:x1875730518556928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 248us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836261.881018:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00010000:00010000:1.0:1788836261.882209:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882225:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882257:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882265:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882286:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882293:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836261.882297:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882306:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882324:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.882332:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909a5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.882438:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2353:x1875730518556672:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 18294us (18505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.882447:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788836261.892184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836261.892563:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518557184 00000100:00100000:3.0:1788836261.892575:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518557184 00000100:00100000:3.0:1788836261.892636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1788836261.892648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+38:10532:x1875730518557184:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788836261.893037:0:5832:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a84d expref: 38 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836261.893549:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788836261.893597:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788836261.894320:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788836261.894600:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.894620:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.894629:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.894740:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.894760:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 42 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.894775:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875730538494976:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836261.897081:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0650780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836261.897234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.897391:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518557312 00000100:00100000:1.0:1788836261.897407:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518557312 00010000:00010000:1.0:1788836261.897442:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 43 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836261.897476:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1788836261.897496:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+43:2354:x1875730518557312:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836261.897510:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836261.897516:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 43 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.897529:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 43 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.897550:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:1.0:1788836261.897555:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.897564:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.897571:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836261.897585:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836261.897921:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+43:2354:x1875730518557312:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 425us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836261.897929:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00010000:00010000:3.0:1788836261.898150:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a82a expref: 42 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836261.898171:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875730538494976:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836261.898194:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.898224:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836261.898230:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836261.898377:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788836261.898796:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788836261.899133:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538495104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788836261.899188:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836261.899325:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836261.905314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538495104 00000100:00100000:1.0:1788836261.905329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538495104 00000100:00080000:3.0:1788836261.905592:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836261.905853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836261.905875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1875730538495104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788836261.906013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1875730538495104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (6824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836261.906099:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538495104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788836261.906990:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788836261.907078:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acc8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538495232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788836261.907126:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836261.907144:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836261.907510:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788836261.907520:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788836261.907776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538495232 00000100:00100000:2.0:1788836261.907784:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538495232 00000100:00100000:0.0:1788836261.908511:0:12002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836261.908523:0:12002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5832:x1875730538495232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788836261.908986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836261.909183:0:12002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5832:x1875730538495232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 662us (2055us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788836261.909191:0:12002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836261.911600:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acc8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538495232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788836261.911988:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788836261.912051:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912062:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912069:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912075:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836261.912079:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912086:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912100:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:2.0:1788836261.912103:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788836261.912107:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836261.912113:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909a61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788836261.917833:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788836261.917987:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788836261.918002:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315052658594ns, next at 316052654822ns, rc = 0 00000001:00080000:2.0:1788836261.918014:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788836261.918070:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd07a955f00) 00010000:00010000:2.0:1788836261.918075:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788836261.918087:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909a4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a84d expref: 46 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836261.918928:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+45:10532:x1875730518557184:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 26276us (26747us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788836261.918941:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000020:00080000:2.0:1788836261.918948:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788836261.929013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836261.930824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518557440 00000100:00100000:0.0:1788836261.930838:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518557440 00000100:00100000:0.0:1788836261.930965:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:0.0:1788836261.930974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+45:10532:x1875730518557440:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836261.930999:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836261.931020:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a854 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.931076:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a854 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.931091:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a854 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836261.931109:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836261.931112:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836261.931116:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836261.931188:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+46:10532:x1875730518557440:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 215us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836261.932544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:0.0:1788836261.935845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836261.936461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518557696 00000100:00100000:1.0:1788836261.936474:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518557696 00000100:00100000:1.0:1788836261.936541:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788836261.936553:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+46:10532:x1875730518557696:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836261.936830:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+47:10532:x1875730518557696:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 278us (994us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788836261.936839:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788836262.031837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.034495:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518557824 00000100:00100000:1.0:1788836262.034511:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518557824 00000100:00100000:1.0:1788836262.034643:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:1.0:1788836262.034655:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+47:10542:x1875730518557824:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1788836262.034745:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034772:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034784:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034800:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034807:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034815:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034941:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034950:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.034957:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836262.034999:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035013:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035020:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035027:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035033:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.035037:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035045:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035056:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.035059:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.035063:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035075:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035089:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035095:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035102:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035106:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.035110:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035116:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035124:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955200) 00010000:00010000:1.0:1788836262.035126:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.035129:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035135:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035148:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035154:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035166:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035172:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ac00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.035175:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035181:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035188:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.035191:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.035208:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.035215:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.035314:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+47:10542:x1875730518557824:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 660us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.035323:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:3.0:1788836262.109454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.109680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518558080 00000100:00100000:1.0:1788836262.109690:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518558080 00000100:00100000:1.0:1788836262.109748:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:1.0:1788836262.109757:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+47:10545:x1875730518558080:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836262.109777:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.109797:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a85b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109909:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109925:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109936:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109950:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109956:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.109963:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110075:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110084:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110091:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.110100:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788836262.110194:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110202:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110215:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110221:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.110225:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110232:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110244:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.110247:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.110251:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110257:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909a8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110271:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110277:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110614:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110623:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.110626:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110643:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110652:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955200) 00010000:00010000:1.0:1788836262.110704:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.110709:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909a92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110759:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909a84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110774:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.110781:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.110783:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836262.110786:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a800, rc 0) 00000100:00100000:1.0:1788836262.110859:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+49:10545:x1875730518558080:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1103us (1415us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788836262.110877:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:0.0:1788836262.119173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836262.133333:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518558208 00000100:00100000:2.0:1788836262.133366:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518558208 00000100:00100000:2.0:1788836262.133458:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:2.0:1788836262.133469:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+49:10545:x1875730518558208:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788836262.133536:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133552:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133565:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133606:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133612:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133618:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133624:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836262.133628:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133635:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133647:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:2.0:1788836262.133650:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836262.133655:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.133671:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.133751:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+49:10545:x1875730518558208:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 283us (14589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836262.133760:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:2.0:1788836262.138296:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.138629:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518558464 00000100:00100000:3.0:1788836262.138640:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518558464 00000100:00100000:3.0:1788836262.138705:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788836262.138715:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+49:10545:x1875730518558464:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788836262.139157:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+50:10545:x1875730518558464:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 441us (880us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788836262.139166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788836262.234990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.235095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518558720 00000100:00100000:1.0:1788836262.235105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518558720 00000100:00100000:1.0:1788836262.235167:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:1.0:1788836262.235177:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+50:10556:x1875730518558720:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836262.235218:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.235221:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836262.235247:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909a29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a83f expref: 50 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235267:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.235272:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836262.235296:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909aae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a862 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235621:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235636:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235644:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235684:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.235697:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 50 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.235709:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538495360:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836262.235923:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836262.238746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.238891:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518558848 00000100:00100000:3.0:1788836262.238899:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518558848 00010000:00010000:3.0:1788836262.238941:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 51 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836262.238980:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788836262.238988:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+51:2353:x1875730518558848:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836262.239014:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836262.239021:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 51 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.239034:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 51 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.239057:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836262.239063:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.239073:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.239081:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.239099:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836262.239153:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+51:2353:x1875730518558848:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 164us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.239160:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00010000:00010000:1.0:1788836262.239238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a85b expref: 50 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.239261:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538495360:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836262.239280:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.239300:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.239306:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.239322:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788836262.239501:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909aae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.239515:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.239522:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.239524:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836262.239527:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978bc00, rc 0) 00000100:00100000:1.0:1788836262.239550:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+50:10556:x1875730518558720:12345-192.168.203.52@tcp:101:bash.0 Request processed in 4376us (4570us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788836262.239557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1788836262.243971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.244194:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559104 00000100:00100000:1.0:1788836262.244203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559104 00000100:00100000:1.0:1788836262.244255:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:1.0:1788836262.244265:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+50:10556:x1875730518559104:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1788836262.244557:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.244574:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.244585:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836262.244626:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788836262.244648:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c30b2d7a reply state 00000000c41decc3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.244657:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836262.244738:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+53:10556:x1875730518559104:12345-192.168.203.52@tcp:36:bash.0 Request processed in 474us (776us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788836262.244745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000020:00080000:1.0:1788836262.244749:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788836262.251268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.251414:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559232 00000100:00100000:0.0:1788836262.251424:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559232 00000100:00100000:0.0:1788836262.251478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:0.0:1788836262.251489:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+53:10556:x1875730518559232:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836262.251513:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836262.251534:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a869 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251609:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251624:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251632:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251640:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251661:0:5830:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251686:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.251701:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836262.251735:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538495488:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836262.251830:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b900 going to sleep for 11 seconds 00010000:00010000:2.0:1788836262.252167:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252176:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252183:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252189:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ac00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836262.252192:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252200:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252214:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:2.0:1788836262.252217:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836262.252220:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252229:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.252235:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909ac3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836262.255022:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538495488:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836262.255054:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836262.255141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.255564:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559360 00000100:00100000:1.0:1788836262.255572:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559360 00010000:00010000:1.0:1788836262.255608:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.255646:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788836262.255664:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+54:2354:x1875730518559360:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836262.255679:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836262.255687:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.255717:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.255741:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ab5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a862 expref: 54 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.255957:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.255963:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.255973:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.255981:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.256011:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836262.256105:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+53:2354:x1875730518559360:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 449us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.256112:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00010000:00010000:3.0:1788836262.256248:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.256268:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836262.256319:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788836262.256324:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836262.256383:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.256423:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 53 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.256441:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.256449:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836262.256451:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836262.256454:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820da200, rc 0) 00000100:00100000:3.0:1788836262.256481:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+52:10556:x1875730518559232:12345-192.168.203.52@tcp:101:bash.0 Request processed in 4994us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.256488:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1788836262.262635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.262772:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559616 00000100:00100000:1.0:1788836262.262782:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559616 00000100:00100000:1.0:1788836262.262836:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1788836262.262846:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+52:10556:x1875730518559616:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836262.263452:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+53:10556:x1875730518559616:12345-192.168.203.52@tcp:35:bash.0 Request processed in 604us (823us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788836262.263460:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788836262.321837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.322062:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559744 00000100:00100000:1.0:1788836262.322074:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559744 00000100:00100000:1.0:1788836262.322138:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1788836262.322148:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+53:10562:x1875730518559744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836262.322173:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.322195:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a870 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322264:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322278:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322509:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.322551:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788836262.322555:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836262.322573:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322602:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a870 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322621:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a870 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.322629:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.322632:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836262.322655:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a800, rc 0) 00000100:00100000:1.0:1788836262.322723:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518559744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 575us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.322731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:0.0:1788836262.329783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.329981:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518559872 00000100:00100000:1.0:1788836262.329991:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518559872 00000100:00100000:1.0:1788836262.330049:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:1.0:1788836262.330060:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518559872:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836262.330082:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.330100:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a877 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330159:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330173:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330186:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330200:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330207:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330214:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330307:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330322:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330329:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.330402:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788836262.330407:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836262.330427:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330439:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330447:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330454:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330461:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330466:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.330470:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330477:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330488:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.330491:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.330500:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330518:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330524:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330531:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330536:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.330538:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330544:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330550:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd07a955200) 00010000:00010000:1.0:1788836262.330552:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.330555:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330561:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330587:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330609:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.330617:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.330619:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836262.330622:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ac00, rc 0) 00000100:00100000:1.0:1788836262.330857:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+55:10562:x1875730518559872:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 797us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.330865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1788836262.344884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836262.344945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.345053:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560128 00000100:00100000:1.0:1788836262.345065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560128 00000100:00100000:1.0:1788836262.345127:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:1.0:1788836262.345138:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:10562:x1875730518560128:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836262.345160:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.345181:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909b02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a87e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345558:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345574:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345582:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345609:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345642:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345728:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 56 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.345743:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538495616:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836262.345921:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.345931:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.345941:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538495744:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836262.345963:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836262.352984:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560256 00000100:00100000:3.0:1788836262.352999:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560256 00010000:00010000:1.0:1788836262.353962:0:5829:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.52@tcp) returned -22 from blocking AST (req@0000000029653195 x1875730538495616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 57 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.353985:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 57 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.354009:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a877 expref: 57 pid: 5831 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.354043:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538495616:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836262.357295:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788836262.357312:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+56:2353:x1875730518560256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836262.357331:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836262.357335:0:8494:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie cb5b7bc40b909afb) 00010000:00010000:3.0:1788836262.357337:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836262.358700:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+56:2353:x1875730518560256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1384us (13746us total) trans 0 rc 116/116 00000100:00100000:3.0:1788836262.358713:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836262.359435:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538495744:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836262.359460:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.359467:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.359478:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.359488:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.366684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.367855:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560384 00000100:00100000:3.0:1788836262.367867:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560384 00010000:00010000:3.0:1788836262.367987:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836262.368083:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788836262.368094:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047940050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+56:2354:x1875730518560384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836262.368112:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836262.368119:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368134:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368158:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a869 expref: 56 pid: 5830 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368176:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836262.368181:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368191:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368198:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.368243:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836262.368441:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047940050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:2354:x1875730518560384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 348us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.368450:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00010000:00010000:2.0:1788836262.368557:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.368566:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836262.368585:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788836262.368744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909b02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.368761:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.368769:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:2.0:1788836262.368771:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836262.368774:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b600, rc 0) 00000100:00100000:2.0:1788836262.368801:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:10562:x1875730518560128:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 23665us (23930us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788836262.368807:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1788836262.372821:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.373892:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560640 00000100:00100000:1.0:1788836262.373913:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560640 00000100:00100000:1.0:1788836262.373988:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788836262.373998:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+55:10562:x1875730518560640:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:1.0:1788836262.374015:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836262.374043:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a854 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.374061:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.374066:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836262.374127:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518560640:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 130us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.374134:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836262.377277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.377378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560768 00000100:00100000:1.0:1788836262.377403:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560768 00000100:00100000:1.0:1788836262.377453:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1788836262.377461:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518560768:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1788836262.377544:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.377559:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.377569:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836262.377775:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788836262.377860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518560768:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 398us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.377868:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:2.0:1788836262.389219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.389500:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518560896 00000100:00100000:0.0:1788836262.389520:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518560896 00000100:00100000:0.0:1788836262.389616:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:0.0:1788836262.389627:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+54:10562:x1875730518560896:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836262.389647:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836262.389667:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a885 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389722:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389734:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 55 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389763:0:8192:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389776:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 55 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389809:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836262.389812:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836262.389816:0:8192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 55 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.389823:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dae00, rc 0) 00000100:00100000:0.0:1788836262.389885:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+55:10562:x1875730518560896:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 261us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836262.389892:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000040:00080000:2.0:1788836262.672637:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836262.672647:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836262.672701:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788836262.672708:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836262.673063:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538495872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836262.673200:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c0b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788836262.674174:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836262.677270:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538495872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836262.682890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.683063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518561024 00000100:00100000:3.0:1788836262.683074:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518561024 00000100:00100000:3.0:1788836262.683180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1788836262.683192:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+55:10563:x1875730518561024:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836262.683227:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836262.683388:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+55:10563:x1875730518561024:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 197us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.683408:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:2.0:1788836262.691768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.691983:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518561152 00000100:00100000:1.0:1788836262.691993:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518561152 00000100:00100000:1.0:1788836262.692052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:1.0:1788836262.692062:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:10563:x1875730518561152:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788836262.692141:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692159:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692171:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692223:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692231:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692238:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692262:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692270:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692277:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.692330:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788836262.692335:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836262.692379:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692401:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692408:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692414:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692431:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978aa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.692435:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692443:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692455:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:1.0:1788836262.692458:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.692462:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692468:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909b25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692483:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692488:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692494:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692499:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.692501:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692507:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692525:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bd07a955200) 00010000:00010000:1.0:1788836262.692528:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.692531:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692536:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692550:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692556:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692562:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692567:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.692570:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692575:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692582:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836262.692584:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.692587:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.692592:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.692688:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:10563:x1875730518561152:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 618us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.692696:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:2.0:1788836262.698980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.699096:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518561408 00000100:00100000:3.0:1788836262.699106:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518561408 00000100:00100000:3.0:1788836262.699166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788836262.699175:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+55:10563:x1875730518561408:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836262.699197:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836262.699216:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909b3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a88c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699320:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699335:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699507:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836262.699522:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788836262.699636:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699644:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699652:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699658:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836262.699662:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699669:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699850:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836262.699855:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836262.699860:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699867:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699920:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909b3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a88c expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699943:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:3.0:1788836262.699946:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836262.699950:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909b3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a88c expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.699961:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c400, rc 0) 00000100:00100000:3.0:1788836262.700024:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518561408:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 851us (1054us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788836262.700032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:2.0:1788836262.723974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.726068:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518561536 00000100:00100000:1.0:1788836262.726084:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518561536 00000100:00100000:1.0:1788836262.726168:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1788836262.726179:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518561536:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836262.726217:0:5829:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836262.726399:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518561536:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 213us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.726409:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1788836262.733698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.733865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518561792 00000100:00100000:0.0:1788836262.733877:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518561792 00000100:00100000:0.0:1788836262.733946:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1788836262.733958:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518561792:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836262.733983:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836262.733987:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788836262.734019:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a870 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.734039:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836262.734044:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836262.734057:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a893 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836262.734535:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788836262.734733:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.735104:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.735116:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.735176:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a893 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.735194:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a893 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.735201:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836262.735204:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836262.735207:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820da200, rc 0) 00000100:00100000:0.0:1788836262.735296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+57:10563:x1875730518561792:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1339us (1621us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788836262.737275:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1788836262.762713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.763037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562048 00000100:00100000:1.0:1788836262.763047:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562048 00000100:00100000:1.0:1788836262.763109:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:1.0:1788836262.763119:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+57:10563:x1875730518562048:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836262.763184:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836262.763213:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a893 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763233:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836262.763244:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836262.763265:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763279:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763324:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763382:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763510:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763521:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763590:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763597:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763602:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763608:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.763612:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763619:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763628:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:1.0:1788836262.763632:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.763635:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763840:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763855:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763861:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763867:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763872:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836262.763875:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763882:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763890:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xec9b4339 (ffff9bd07a955200) 00010000:00010000:1.0:1788836262.763892:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836262.763895:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.763911:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec9b4339 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.764109:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518562048:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 989us (1404us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836262.764117:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1788836262.777517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.777930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562176 00000100:00100000:3.0:1788836262.777940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562176 00000100:00100000:3.0:1788836262.778039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788836262.778049:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+56:10563:x1875730518562176:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836262.778070:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836262.778091:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909b72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a89a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778127:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778140:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778151:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778246:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778269:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.778278:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:3.0:1788836262.778281:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836262.778285:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c600, rc 0) 00000100:00100000:3.0:1788836262.778388:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+57:10563:x1875730518562176:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 341us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.778402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1788836262.794527:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.795695:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562432 00000100:00100000:0.0:1788836262.795708:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562432 00000100:00100000:0.0:1788836262.795778:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1788836262.795787:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+57:10563:x1875730518562432:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836262.795864:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.795880:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.795918:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836262.796162:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788836262.796172:0:8192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315930828194ns, next at 316930826054ns, rc = 0 00000004:00010000:0.0:1788836262.796252:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ca0e1f6 reply state 00000000347e6b5a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836262.796261:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836262.796424:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+59:10563:x1875730518562432:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 637us (1906us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788836262.796431:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00010000:00010000:0.0:1788836262.798549:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798566:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798575:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798582:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836262.798588:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798596:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798614:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:0.0:1788836262.798617:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836262.798638:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.798645:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909b80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.804329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.804644:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562560 00000100:00100000:0.0:1788836262.804668:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562560 00000100:00100000:0.0:1788836262.804728:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788836262.804739:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+58:10563:x1875730518562560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836262.804921:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836262.804942:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.805000:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.805014:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.805032:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:0.0:1788836262.805035:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836262.805038:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836262.805098:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+59:10563:x1875730518562560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 361us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836262.805105:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:2.0:1788836262.808469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.808989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562688 00000100:00100000:0.0:1788836262.809001:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562688 00000100:00100000:0.0:1788836262.809077:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788836262.809095:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518562688:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788836262.809490:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836262.810013:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518562688:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 916us (1550us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788836262.810023:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788836262.817450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.817621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518562944 00000100:00100000:3.0:1788836262.817631:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518562944 00000100:00100000:3.0:1788836262.817706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788836262.817716:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+59:10563:x1875730518562944:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836262.817968:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+60:10563:x1875730518562944:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 253us (525us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788836262.817976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788836262.820489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.823089:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563200 00000100:00100000:0.0:1788836262.823105:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563200 00000100:00100000:0.0:1788836262.823218:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:0.0:1788836262.823229:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+60:10563:x1875730518563200:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788836262.823388:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+60:10563:x1875730518563200:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 159us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836262.823406:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788836262.828052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.832735:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563328 00000100:00100000:1.0:1788836262.832749:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563328 00000100:00100000:1.0:1788836262.832822:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788836262.832831:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+60:10563:x1875730518563328:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836262.832850:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.832868:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8a8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.832989:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.833007:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.833019:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836262.833054:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836262.833072:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.833098:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a8 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.833116:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a8 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.833124:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:1.0:1788836262.833126:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836262.833129:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ae00, rc 0) 00000100:00100000:1.0:1788836262.833204:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:10563:x1875730518563328:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 374us (5163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.833211:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1788836262.840935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.841013:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563456 00000100:00100000:1.0:1788836262.841022:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563456 00000100:00100000:1.0:1788836262.841102:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1788836262.841111:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2356:x1875730518563456:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836262.841129:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.841146:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8af expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836262.841171:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f79a5, blocks: 0x1 00010000:00010000:1.0:1788836262.841188:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:1.0:1788836262.841193:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836262.841202:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.841218:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.841230:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a600, rc 0) 00000100:00100000:1.0:1788836262.841295:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+10:2356:x1875730518563456:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 185us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.841302:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788836262.846397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836262.846477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563712 00000100:00100000:0.0:1788836262.846487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563712 00000100:00100000:0.0:1788836262.846544:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788836262.846555:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:10563:x1875730518563712:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788836262.846673:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:10563:x1875730518563712:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 119us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836262.846680:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788836262.849957:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.850056:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563840 00000100:00100000:1.0:1788836262.850066:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563840 00000100:00100000:1.0:1788836262.850173:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788836262.850182:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:10563:x1875730518563840:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836262.850200:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836262.850216:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8b6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.850247:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.850257:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836262.850261:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836262.850266:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.850297:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.850310:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 11 pid: 6681 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.850324:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538496000:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836262.850448:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836262.856811:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.856925:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518563968 00000100:00100000:3.0:1788836262.856934:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518563968 00010000:00010000:3.0:1788836262.856975:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 12 pid: 6681 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836262.857022:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788836262.857031:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+12:2353:x1875730518563968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836262.857058:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836262.857081:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 12 pid: 6681 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.857095:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 12 pid: 6681 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.857123:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836262.857128:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836262.857137:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.857148:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.857184:0:8494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836262.857199:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8494:1875730538496128:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788836262.857382:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6197f35/0xcb5b7bc40b909b9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8af expref: 12 pid: 6681 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836262.857398:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538496000:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836262.857427:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836262.857436:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:3.0:1788836262.857528:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836262.860004:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+11:10563:x1875730518563840:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 9812us (10044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.860016:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836262.872502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.872593:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8494:1875730538496128:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788836262.872628:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836262.872742:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+10:2353:x1875730518563968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 15711us (15940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836262.872753:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788836262.876390:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564096 00000100:00100000:1.0:1788836262.876409:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564096 00002000:00100000:1.0:1788836262.876475:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bd079794380 x1875730518564096/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:428/0 lens 504/0 e 0 to 0 dl 1788836273 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836262.876486:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd079794380 with x1875730518564096 ext(0->12) 00002000:00010000:1.0:1788836262.876492:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd079794380 00000100:00100000:1.0:1788836262.876528:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836262.876539:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:2353:x1875730518564096:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788836262.883205:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+12:2353:x1875730518564096:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 6658us (10702us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788836262.883221:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:1.0:1788836262.883235:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bd079794380 x1875730518564096/t4294967308(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:428/0 lens 504/448 e 0 to 0 dl 1788836273 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836262.883245:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd079794380 with x1875730518564096 ext(0->12) 00002000:00010000:1.0:1788836262.883252:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd079794380 00000100:00100000:0.0:1788836262.887531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836262.887642:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564224 00000100:00100000:1.0:1788836262.887651:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564224 00000100:00100000:1.0:1788836262.887724:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788836262.887733:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+61:10563:x1875730518564224:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788836262.957309:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+61:10563:x1875730518564224:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 69564us (69776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836262.957322:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000001:00080000:0.0:1788836262.957822:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788836262.957830:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788836262.957886:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788836262.957928:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd054bcec00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788836262.957932:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048bd3400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd054bced80 00000020:00080000:0.0:1788836262.957935:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048bd3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07af16400 00000004:00080000:0.0:1788836262.957959:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788836262.957971:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd0479c00c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788836262.957975:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd042cfa400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0479c0780 00000020:00080000:0.0:1788836262.957978:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd042cfa000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07af54400 00000001:00080000:0.0:1788836262.957993:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788836262.958067:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788836262.958260:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788836262.958378:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836262.958393:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538496256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788836262.958445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836262.958520:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538496256 00000100:00100000:2.0:1788836262.958529:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538496256 00000100:00100000:2.0:1788836262.958569:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836262.958577:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875730538496256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788836262.958604:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788836262.958636:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f79a4, atime: 0x6a9f79a4, ctime: 0x6a9f79a4, blocks: 0x1 00010000:00010000:2.0:1788836262.958645:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.958671:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1788836262.958676:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836262.958682:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.958714:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.958724:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.958731:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.958747:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836262.959185:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3304:x1875730538496256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 607us (738us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788836262.959193:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788836262.959218:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836262.959224:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.959233:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836262.959238:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.959248:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.959266:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.959281:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d71f9b3a/0xcb5b7bc40b909baa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.959301:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836262.959304:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836262.959305:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788836262.959338:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07ac80e00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788836262.959387:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538496256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788836262.964675:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538496384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788836262.964751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836262.964835:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538496384 00000100:00100000:2.0:1788836262.964843:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538496384 00000100:00100000:2.0:1788836262.964915:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836262.964924:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538496384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788836262.964951:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788836262.964979:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.965000:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.965007:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788836262.965011:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836262.965014:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.965040:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.965069:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 11 pid: 6681 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.965080:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538496512:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836262.965137:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836262.965590:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538496640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788836262.965623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836262.965664:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836262.965670:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788836262.965762:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538496640 00000100:00100000:2.0:1788836262.965767:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538496640 00000100:00100000:2.0:1788836262.965849:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836262.965858:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875730538496640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788836262.966025:0:12003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788836262.966030:0:12003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788836261 00002000:00010000:2.0:1788836262.966032:0:12003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788836262.966034:0:12003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788836261 -> 1788836261 00002000:00010000:2.0:1788836262.966037:0:12003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788836262.966078:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1875730538496640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (454us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788836262.966086:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788836262.966127:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd043072300/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788836262.966134:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538496640:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788836262.966627:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836262.966991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836262.967062:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564352 00000100:00100000:3.0:1788836262.967069:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564352 00000100:00100000:3.0:1788836262.967109:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836262.967117:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+12:2354:x1875730518564352:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788836262.974466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836262.974537:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538496512:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836262.975295:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.975377:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564480 00000100:00100000:2.0:1788836262.975386:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564480 00010000:00010000:2.0:1788836262.975422:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 13 pid: 6681 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836262.975456:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788836262.975466:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:2354:x1875730518564480:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836262.975480:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836262.975486:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 13 pid: 6681 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.975499:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 13 pid: 6681 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.975523:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453fcef2/0xcb5b7bc40b90996c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a815 expref: 13 pid: 6681 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.975537:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836262.975542:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836262.975547:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.977151:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836262.977229:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836262.977315:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+12:2354:x1875730518564480:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1846us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836262.977325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:0.0:1788836262.978164:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.978178:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.978187:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.978196:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836262.978222:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836262.979459:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3302:x1875730538496384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14532us (14705us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788836262.979481:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788836262.980194:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836262.980204:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.980228:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836262.980232:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.980244:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.980266:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.980274:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df1cf7f/0xcb5b7bc40b909bb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836262.980295:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836262.980297:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836262.980299:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788836262.981558:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd043071500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788836262.981582:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538496384:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788836263.060489:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788836263.060517:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788836263.060531:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788836263.062222:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518564352:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 95095us (95224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836263.062251:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788836263.079602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836263.079707:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564736 00000100:00100000:0.0:1788836263.079719:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564736 00000100:00100000:0.0:1788836263.079798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1788836263.079808:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+15:10563:x1875730518564736:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836263.079860:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836263.079887:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909b95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a8 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.079915:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:0.0:1788836263.079919:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836263.079948:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.079962:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.079971:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836263.080228:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027962b10 reply state 00000000cd702dd3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.080239:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1788836263.080412:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836263.080497:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:10563:x1875730518564736:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 688us (902us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788836263.080504:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1788836263.088685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836263.088957:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518564864 00000100:00100000:3.0:1788836263.088967:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518564864 00000100:00100000:3.0:1788836263.089024:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788836263.089034:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518564864:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788836263.089241:0:12003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788836263.089245:0:12003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788836261 -> 1788836260 00002000:00010000:3.0:1788836263.089247:0:12003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788836260 00002000:00010000:3.0:1788836263.089250:0:12003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788836261 -> 1788836260 00002000:00010000:3.0:1788836263.089252:0:12003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788836263.089314:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518564864:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 281us (638us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788836263.089322:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00010000:00010000:2.0:1788836263.089978:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.089990:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.089998:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.090004:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836263.090008:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.090016:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.090032:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:2.0:1788836263.090035:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836263.090039:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.090065:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.102846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836263.102953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565120 00000100:00100000:3.0:1788836263.102963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565120 00000100:00100000:3.0:1788836263.103020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:3.0:1788836263.103030:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+15:10563:x1875730518565120:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788836263.103102:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.103119:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.103130:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.103171:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.103185:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 15 pid: 5831 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836263.103199:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538496768:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836263.103312:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd065078300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836263.135212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.135257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.135320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.135397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.135431:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565376 00000100:00100000:1.0:1788836263.135440:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565376 00000100:00100000:1.0:1788836263.135501:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788836263.135511:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518565376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836263.135583:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518565376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836263.135590:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788836263.135612:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565632 00000100:00100000:1.0:1788836263.135616:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565632 00010000:00010000:1.0:1788836263.135637:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 16 pid: 5831 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836263.136205:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538496768:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836263.136230:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836263.136274:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836263.136856:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788836263.136874:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:2355:x1875730518565632:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836263.136888:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788836263.136993:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565504 00000100:00100000:0.0:1788836263.136998:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565504 00000100:00100000:0.0:1788836263.137038:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:0.0:1788836263.137045:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518565504:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836263.137108:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518565504:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836263.137115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00010000:00010000:1.0:1788836263.137241:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 16 pid: 5831 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.137257:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 16 pid: 5831 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.137280:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a89a expref: 16 pid: 5831 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.137301:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:1.0:1788836263.137306:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.137317:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.137326:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836263.137985:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565248 00000100:00100000:3.0:1788836263.137992:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565248 00000100:00100000:3.0:1788836263.138042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 284 00000100:00100000:3.0:1788836263.138050:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518565248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836263.138096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518565248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 47us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836263.138103:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 284 00000100:00080000:2.0:1788836263.139135:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836263.144774:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836263.144861:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+15:2355:x1875730518565632:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7981us (9455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836263.144875:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:2.0:1788836263.146126:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146142:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146172:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146178:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146184:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146199:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836263.146203:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146210:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146243:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:2.0:1788836263.146246:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788836263.146251:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.146257:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909bbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836263.146338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:10563:x1875730518565120:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 43306us (43498us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788836263.146383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:2.0:1788836263.150816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836263.151168:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565760 00000100:00100000:3.0:1788836263.151179:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565760 00000100:00100000:0.0:1788836263.152016:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788836263.152031:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518565760:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788836263.152082:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.152105:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.152114:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788836263.152119:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836263.152123:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.152162:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.152209:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 7 pid: 6680 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.152225:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079795880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875730538496896:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836263.152336:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836263.155625:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079795880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875730538496896:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836263.155667:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836263.157671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836263.158788:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518565888 00000100:00100000:3.0:1788836263.158801:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518565888 00010000:00010000:3.0:1788836263.158849:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 8 pid: 6680 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836263.158914:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788836263.158925:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518565888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836263.158943:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836263.158984:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 8 pid: 6680 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.159000:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 8 pid: 6680 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.159025:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbb6a525/0xcb5b7bc40b909ba3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8b6 expref: 8 pid: 6680 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.159044:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836263.159050:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836263.159055:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.159065:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836263.159112:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836263.159171:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518565888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 248us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836263.159179:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00010000:00010000:1.0:1788836263.160397:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160414:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160465:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160472:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160480:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160487:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836263.160492:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160501:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160520:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.160527:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008376aaf0/0xcb5b7bc40b909bc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836263.160607:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518565760:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 8578us (9798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836263.160617:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788836263.165328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.165517:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518566144 00000100:00100000:1.0:1788836263.165528:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518566144 00000100:00100000:1.0:1788836263.165588:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:1.0:1788836263.165599:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+14:10563:x1875730518566144:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788836263.165687:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165705:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165717:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165931:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165942:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165950:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165983:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.165997:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 15 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836263.166009:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538497024:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836263.166091:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836263.170470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836263.170553:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518566272 00000100:00100000:2.0:1788836263.170563:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518566272 00010000:00010000:2.0:1788836263.170601:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 16 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836263.170636:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788836263.170645:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:2353:x1875730518566272:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836263.170664:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836263.170678:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 16 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.170707:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 16 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.170728:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:2.0:1788836263.170734:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.170742:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.170749:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.170767:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836263.170823:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+16:2353:x1875730518566272:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 179us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836263.170830:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:0.0:1788836263.171412:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909b87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8a1 expref: 15 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.171429:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538497024:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836263.171449:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.171458:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.171464:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836263.171663:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788836263.172023:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788836263.172073:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788836263.172170:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538497152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788836263.172227:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836263.172311:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836263.174096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538497152 00000100:00100000:2.0:1788836263.174108:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538497152 00000100:00100000:2.0:1788836263.174216:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836263.174227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8192:x1875730538497152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788836263.174384:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8192:x1875730538497152:12345-0@lo:1000:mdt00_003.0 Request processed in 158us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836263.174392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836263.174477:0:8192:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788836263.174497:0:8192:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788836263.174519:0:8192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd043072300, transno 4294967309 00000100:00100000:0.0:1788836263.174545:0:8192:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd043071500 x1875730538496384/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788836278 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836263.174558:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538497152:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788836263.175079:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788836263.175166:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538497280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788836263.175214:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836263.176083:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836263.176147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538497280 00000100:00100000:1.0:1788836263.176154:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538497280 00000100:00100000:1.0:1788836263.176190:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836263.176198:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8192:x1875730538497280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788836263.176401:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8192:x1875730538497280:12345-0@lo:1000:mdt00_003.0 Request processed in 203us (1186us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788836263.176408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836263.176499:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538497280:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788836263.176536:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176546:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176553:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176560:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.176565:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176572:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176588:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd0452e2c00) 00010000:00010000:0.0:1788836263.176591:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836263.176595:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176610:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b909bd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176639:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176645:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176660:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176666:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ac00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.176677:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176683:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176692:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836263.176694:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836263.176701:0:8192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176712:0:8192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176721:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.176760:0:8192:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.176772:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538497408:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788836263.176835:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836263.183495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836263.183644:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538497408:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788836263.183675:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183687:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b909b17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183721:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183735:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183746:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183755:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183761:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183768:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183792:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dbc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.183796:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183803:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183814:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836263.183818:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836263.183821:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183827:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909bdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183837:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183843:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183848:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183853:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.183855:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183866:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183884:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836263.183886:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836263.183890:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.183906:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909bcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836263.184208:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518566400 00000100:00100000:2.0:1788836263.184216:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518566400 00000100:00100000:2.0:1788836263.184283:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788836263.184293:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:10562:x1875730518566400:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:0.0:1788836263.184466:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:10563:x1875730518566144:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 18868us (19146us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788836263.184475:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000020:00080000:0.0:1788836263.184481:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788836263.187439:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836263.187449:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836263.187975:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788836263.187985:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836263.192559:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+18:10562:x1875730518566400:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 8255us (9062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836263.192575:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788836263.196533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836263.196642:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518566912 00000100:00100000:0.0:1788836263.196653:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518566912 00000100:00100000:0.0:1788836263.196715:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:0.0:1788836263.196726:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:10562:x1875730518566912:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:0.0:1788836263.197115:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788836263.197147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836263.197219:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:10562:x1875730518566912:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 493us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836263.197228:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518566656 00000100:00100000:0.0:1788836263.197229:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:2.0:1788836263.197235:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518566656 00000100:00100000:2.0:1788836263.197273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788836263.197280:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:10563:x1875730518566656:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836263.197772:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836263.197880:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788836263.197942:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.197961:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.197973:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.197982:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.197988:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.197994:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836263.198018:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836263.198075:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:10563:x1875730518566656:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 795us (930us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788836263.198091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000020:00080000:2.0:1788836263.198096:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788836263.198096:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836263.198106:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.198115:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836263.198120:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.198140:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.198154:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:0.0:1788836263.198158:0:6696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788836263.198163:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.198169:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909be2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.198185:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836263.198187:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836263.198189:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836263.227988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836263.228216:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567040 00000100:00100000:0.0:1788836263.228226:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567040 00000100:00100000:0.0:1788836263.228326:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:0.0:1788836263.228335:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:10565:x1875730518567040:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836263.230532:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836263.230562:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909be9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230632:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230704:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230719:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230751:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230759:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.230766:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.231002:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.231016:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.231023:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.231057:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.231073:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 21 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836263.231086:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538497536:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836263.231527:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836263.233978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836263.234315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567296 00000100:00100000:2.0:1788836263.234326:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567296 00000100:00100000:2.0:1788836263.234420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788836263.234430:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:5589:x1875730518567296:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788836263.234670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:5589:x1875730518567296:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 240us (699us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788836263.234677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788836263.235014:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538497536:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836263.235042:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836263.236915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836263.237518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567424 00000100:00100000:1.0:1788836263.237527:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567424 00010000:00010000:1.0:1788836263.237568:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 23 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836263.237611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788836263.237622:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047942850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:2353:x1875730518567424:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836263.237634:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836263.237641:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 23 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237653:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 23 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237689:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909b09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a87e expref: 23 pid: 5829 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237705:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836263.237710:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237719:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237726:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836263.237755:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836263.237814:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047942850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:2353:x1875730518567424:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 195us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836263.237821:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00010000:00010000:0.0:1788836263.237927:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.237936:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836263.237981:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788836263.237986:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836263.238005:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238018:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238027:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238033:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238040:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238046:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.238050:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238057:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238066:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:0.0:1788836263.238077:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836263.238082:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238087:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238100:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238105:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238110:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238115:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836263.238117:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238123:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238130:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd0498ed000) 00010000:00010000:0.0:1788836263.238132:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836263.238135:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238139:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238174:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909be9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8bd expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238201:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8bd expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836263.238208:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836263.238210:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836263.238213:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:0.0:1788836263.238239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:10565:x1875730518567040:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 9906us (10260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836263.238246:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000001:00080000:3.0:1788836263.299238:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788836263.299263:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788836263.299273:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1788836263.697501:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836264.083874:0:12042:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836264.083884:0:12042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836264.083935:0:12042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788836264.083940:0:12042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788836264.209529:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788836264.209538:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836264.209617:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788836264.209625:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788836264.209744:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538497664:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836264.209849:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836264.246598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836264.246680:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538497664:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836264.246997:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567552 00000100:00100000:3.0:1788836264.247005:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567552 00000100:00100000:3.0:1788836264.247071:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788836264.247080:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:10577:x1875730518567552:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836264.247111:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836264.250037:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:10577:x1875730518567552:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 2947us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836264.250052:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788836264.254081:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836264.258100:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567808 00000100:00100000:1.0:1788836264.258114:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567808 00000100:00100000:1.0:1788836264.258175:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1788836264.258186:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+21:10577:x1875730518567808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836264.258218:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836264.258240:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909c05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8c4 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836264.258366:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836264.258380:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836264.258393:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836264.258405:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788836264.258534:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909c05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8c4 expref: 24 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836264.258553:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8c4 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836264.258561:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836264.258564:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836264.258567:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a000, rc 0) 00000100:00100000:1.0:1788836264.258633:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:10577:x1875730518567808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 448us (4562us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788836264.258642:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1788836264.266904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836264.267860:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518567936 00000100:00100000:0.0:1788836264.267870:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518567936 00000100:00100000:0.0:1788836264.267943:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836264.267955:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:2353:x1875730518567936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836264.267970:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836264.267995:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8c4 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836264.268010:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:0.0:1788836264.268015:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836264.268072:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+22:2353:x1875730518567936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 119us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836264.268079:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836264.271567:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836264.271608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518568192 00000100:00100000:3.0:1788836264.271617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518568192 00000100:00100000:3.0:1788836264.272590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788836264.275120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:10577:x1875730518568192:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836264.275209:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275225:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275236:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275439:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275446:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275453:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275469:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836264.275474:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275480:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275492:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836264.275494:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836264.275499:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836264.275504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836264.275860:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836264.275865:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836264.276365:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788836264.276378:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836264.278281:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:10577:x1875730518568192:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 5671us (6713us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788836264.278296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788836264.282197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836264.282233:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518568448 00000100:00100000:3.0:1788836264.282244:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518568448 00000100:00100000:3.0:1788836264.282291:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788836264.282300:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:10577:x1875730518568448:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836264.282549:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+24:10577:x1875730518568448:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 249us (361us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788836264.282558:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00010000:00010000:3.0:1788836264.720518:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836264.785316:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538498048:0@lo:400:kworker.0 00000100:00100000:1.0:1788836264.785420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836264.785485:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836264.785491:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498176:0@lo:400:kworker.0 00000100:00100000:1.0:1788836264.785521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836264.785557:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498176 00000100:00100000:1.0:1788836264.785576:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498176 00000100:00100000:1.0:1788836264.785629:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788836264.785638:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538498176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.785757:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538497792:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.785791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836264.785816:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538498304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.785838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836264.785854:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836264.785859:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538497920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.785879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836264.785909:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538498432:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.785931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836264.785969:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836264.785979:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498432 00000100:00100000:2.0:1788836264.785983:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498432 00000100:00100000:2.0:1788836264.786014:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836264.786021:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538498432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786070:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538498432:12345-0@lo:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836264.786077:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836264.786099:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538497792 00000100:00100000:2.0:1788836264.786102:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538497792 00000100:00100000:2.0:1788836264.786128:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788836264.786134:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538497792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786162:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538497792:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836264.786167:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788836264.786196:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498048 00000100:00100000:2.0:1788836264.786200:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498048 00000100:00100000:2.0:1788836264.786224:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498304 00000100:00100000:2.0:1788836264.786226:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498304 00000100:00100000:2.0:1788836264.786238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538497920 00000100:00100000:2.0:1788836264.786240:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538497920 00000100:00100000:2.0:1788836264.786252:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788836264.786257:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538498048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786293:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538498048:12345-0@lo:400:kworker.0 Request processed in 36us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836264.786299:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788836264.786311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788836264.786316:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538498304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786381:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538498304:12345-0@lo:400:kworker.0 Request processed in 64us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836264.786388:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788836264.786400:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788836264.786407:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538497920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786435:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538497920:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836264.786442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788836264.786460:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836264.786463:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836264.786489:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538497920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786502:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538498432:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786511:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538497792:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538498304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.786558:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538498048:0@lo:400:kworker.0 00000100:00100000:1.0:1788836264.787278:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538498176:12345-0@lo:400:kworker.0 Request processed in 1640us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836264.787287:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836264.789090:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788836264.789102:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788836264.789128:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07a727480, transno 4294967301 00000004:00080000:2.0:1788836264.789163:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788836264.789175:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07ac80e00, transno 4294967304 00000100:00100000:2.0:1788836264.789183:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836264.790849:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836264.790931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836264.791066:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498560 00000100:00100000:3.0:1788836264.791074:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498560 00000100:00100000:3.0:1788836264.791125:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836264.791135:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538498560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836264.791169:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836264.791222:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538498560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836264.791228:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788836264.792270:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836265.300875:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836265.300910:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836265.300988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836265.301068:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498688 00000100:00100000:3.0:1788836265.301076:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498688 00000100:00100000:3.0:1788836265.301127:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836265.301136:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875730538498688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836265.301173:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836265.301218:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875730538498688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836265.301225:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836265.301270:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538498688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836265.748116:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836266.062931:0:12093:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836266.062941:0:12093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836266.062986:0:12093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788836266.062992:0:12093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836266.218089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836266.218167:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518568704 00000100:00100000:2.0:1788836266.218178:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518568704 00000100:00100000:2.0:1788836266.218266:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788836266.218277:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:10597:x1875730518568704:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836266.218303:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836266.218324:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b909c21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8cb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.218451:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909c28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.218467:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.218481:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836266.218492:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788836266.218823:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b909c21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8cb expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.218841:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8cb expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.218942:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:2.0:1788836266.218946:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788836266.218950:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999a00, rc 0) 00000100:00100000:2.0:1788836266.219047:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+26:10597:x1875730518568704:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 771us (968us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788836266.219054:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00080000:3.0:1788836266.219120:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836266.225133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836266.225205:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518568832 00000100:00100000:1.0:1788836266.225216:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518568832 00000100:00100000:1.0:1788836266.225273:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788836266.225283:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+26:10597:x1875730518568832:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788836266.225372:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225390:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225400:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225426:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225432:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225448:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225453:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836266.225457:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225464:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225475:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:1.0:1788836266.225479:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836266.225483:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836266.225489:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836266.225556:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+26:10597:x1875730518568832:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 274us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836266.225563:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788836266.345034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836266.345146:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518568960 00000100:00100000:2.0:1788836266.345156:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518568960 00000100:00100000:2.0:1788836266.345225:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788836266.345235:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518568960:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788836266.345254:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836266.345273:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdedd658/0xcb5b7bc40b909c3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8d2 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836266.345299:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f79a4, atime: 0x6a9f79a4, ctime: 0x6a9f79a4, blocks: 0xb 00010000:00010000:2.0:1788836266.345316:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788836266.345321:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836266.345330:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdedd658/0xcb5b7bc40b909c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d2 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.345368:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdedd658/0xcb5b7bc40b909c3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d2 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836266.345382:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998800, rc 0) 00000100:00100000:2.0:1788836266.345448:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518568960:12345-192.168.203.52@tcp:101:cat.0 Request processed in 214us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836266.345455:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00080000:3.0:1788836266.345791:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836266.351559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836266.351788:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569088 00000100:00100000:2.0:1788836266.351803:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569088 00002000:00100000:2.0:1788836266.351883:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bd07ad1e300 x1875730518569088/t0(0) o3->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:432/0 lens 488/0 e 0 to 0 dl 1788836277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836266.351896:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07ad1e300 with x1875730518569088 ext(0->4095) 00002000:00010000:2.0:1788836266.351903:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07ad1e300 00000100:00100000:2.0:1788836266.351983:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788836266.351996:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518569088:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:2.0:1788836266.352394:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518569088:12345-192.168.203.52@tcp:3:cat.0 Request processed in 399us (854us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788836266.352415:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:2.0:1788836266.352424:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9bd07ad1e300 x1875730518569088/t0(0) o3->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:432/0 lens 488/4536 e 0 to 0 dl 1788836277 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788836266.352431:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07ad1e300 with x1875730518569088 ext(0->4095) 00002000:00010000:2.0:1788836266.352435:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07ad1e300 00010000:00010000:2.0:1788836266.771177:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836267.795633:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836268.230013:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836268.230048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836268.230091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836268.230117:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569216 00000100:00100000:0.0:1788836268.230122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836268.230126:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569216 00000100:00100000:0.0:1788836268.230141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836268.230182:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:3.0:1788836268.230205:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518569216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836268.230291:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2353:x1875730518569216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836268.230299:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:1.0:1788836268.230311:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569472 00000100:00100000:1.0:1788836268.230315:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569472 00000100:00100000:3.0:1788836268.230365:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569600 00000100:00100000:3.0:1788836268.230369:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569600 00000100:00100000:1.0:1788836268.230379:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788836268.230385:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518569472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836268.230391:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1788836268.230397:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518569600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836268.230415:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2353:x1875730518569472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836268.230418:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518569600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836268.230423:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788836268.230429:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00080000:3.0:1788836268.230447:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836268.230452:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836268.230512:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569728 00000100:00100000:2.0:1788836268.230517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569728 00000100:00080000:3.0:1788836268.230558:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836268.230561:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569344 00000100:00100000:2.0:1788836268.230564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569344 00000100:00100000:3.0:1788836268.230577:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788836268.230584:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2353:x1875730518569728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836268.230588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788836268.230594:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+26:2353:x1875730518569344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836268.230611:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2353:x1875730518569728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836268.230616:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+26:2353:x1875730518569344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836268.230628:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00080000:3.0:1788836268.230649:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836268.233842:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000001:00080000:1.0:1788836268.453468:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788836268.453483:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788836268.453489:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788836268.483383:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:0.0:1788836268.483397:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd0496b6000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788836268.483402:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bcf41082d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0515066c0 00000020:00080000:0.0:1788836268.483405:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bcf41082a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07ac87800 00000001:00080000:0.0:1788836268.483431:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1788836268.483438:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788836268.483448:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788836268.487532:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788836268.487776:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788836268.818661:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836269.845875:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836269.904618:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836269.905382:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538498944:0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.906845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836269.906921:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498944 00000100:00100000:3.0:1788836269.906923:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538498816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836269.906929:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498944 00000100:00100000:3.0:1788836269.906967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836269.906974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788836269.906983:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538498944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.906999:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538498816 00000100:00100000:3.0:1788836269.907002:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538498816 00000100:00100000:0.0:1788836269.907033:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538498944:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836269.907035:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836269.907040:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788836269.907041:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538498816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836269.907067:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836269.907098:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538498816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836269.907104:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788836269.907122:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836269.907183:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538499072:0@lo:400:kworker.0 00000100:00100000:1.0:1788836269.907214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836269.907219:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538498944:0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.907240:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538498816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836269.907269:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499072 00000100:00100000:0.0:1788836269.907273:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499072 00000100:00100000:0.0:1788836269.907305:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788836269.907312:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538499072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836269.907457:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538499072:12345-0@lo:400:kworker.0 Request processed in 145us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836269.907473:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788836269.907848:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538499200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836269.907887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836269.907889:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538499456:0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.907913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836269.907918:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499200 00000100:00100000:2.0:1788836269.907921:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499200 00000100:00100000:3.0:1788836269.907931:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836269.907937:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538499328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836269.907948:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788836269.907954:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538499200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.907956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836269.907977:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499456 00000100:00100000:3.0:1788836269.907981:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499456 00000100:00100000:2.0:1788836269.907984:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538499200:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836269.907989:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788836269.907999:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499328 00000100:00100000:2.0:1788836269.908002:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499328 00000100:00100000:3.0:1788836269.908006:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836269.908012:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538499456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836269.908018:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788836269.908022:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538499328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.908044:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538499456:12345-0@lo:400:kworker.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836269.908044:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538499328:12345-0@lo:400:kworker.0 Request processed in 21us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836269.908050:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788836269.908051:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788836269.908068:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836269.908071:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836269.908076:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538499200:0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.908091:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538499328:0@lo:400:kworker.0 00000100:00100000:3.0:1788836269.908099:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788836269.908104:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd043071500, transno 4294967310 00000004:00080000:3.0:1788836269.908112:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788836269.908127:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538499456:0@lo:400:kworker.0 00000100:00100000:1.0:1788836269.909518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538499072:0@lo:400:kworker.0 00000100:00100000:2.0:1788836270.416994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836270.417018:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538499584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836270.417086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836270.421200:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499584 00000100:00100000:3.0:1788836270.421215:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499584 00000100:00100000:3.0:1788836270.421295:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788836270.421306:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538499584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836270.421371:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836270.421470:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538499584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836270.421477:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836270.421720:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538499584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788836270.870627:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836271.895909:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836271.938155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836271.938248:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518569856 00000100:00100000:2.0:1788836271.938259:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518569856 00000100:00100000:2.0:1788836271.938372:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1788836271.938384:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:10249:x1875730518569856:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788836271.938480:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:10249:x1875730518569856:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 99us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836271.938489:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00080000:3.0:1788836271.938725:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836271.940961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836271.941424:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570112 00000100:00100000:0.0:1788836271.941435:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570112 00000100:00100000:0.0:1788836271.941494:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788836271.941504:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+13:10249:x1875730518570112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788836271.942523:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:10249:x1875730518570112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1016us (1566us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788836271.942533:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:1.0:1788836272.412706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836272.412800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570240 00000100:00100000:3.0:1788836272.412809:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570240 00000100:00100000:3.0:1788836272.412897:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:3.0:1788836272.412919:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:11049:x1875730518570240:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:3.0:1788836272.412939:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836272.412960:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413021:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413034:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413059:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836272.413092:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788836272.413096:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836272.413145:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413169:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413186:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836272.413195:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836272.413197:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836272.413200:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c400, rc 0) 00000100:00100000:3.0:1788836272.413261:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:11049:x1875730518570240:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 355us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836272.413268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00080000:0.0:1788836272.414498:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788836272.465060:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836272.465070:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836272.465378:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788836272.465385:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788836272.913082:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836273.360109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836273.360154:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836273.360176:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570368 00000100:00100000:3.0:1788836273.360186:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570368 00000100:00100000:3.0:1788836273.360241:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 288 00000100:00100000:3.0:1788836273.360252:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518570368:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836273.360327:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0466b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518570368:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836273.360373:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 288 00000100:00100000:1.0:1788836273.363016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836273.363063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836273.363096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836273.363171:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570880 00000100:00100000:0.0:1788836273.363180:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570880 00000100:00100000:0.0:1788836273.363234:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570496 00000100:00100000:0.0:1788836273.363238:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570496 00000100:00100000:3.0:1788836273.363276:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570624 00000100:00100000:0.0:1788836273.363278:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:3.0:1788836273.363283:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570624 00000100:00100000:0.0:1788836273.363290:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2355:x1875730518570880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836273.363401:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2355:x1875730518570880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 112us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836273.363402:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518570752 00000100:00100000:3.0:1788836273.363408:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518570752 00000100:00100000:0.0:1788836273.363412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1788836273.363436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1788836273.363442:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788836273.363447:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:2355:x1875730518570496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836273.363454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518570624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836273.363482:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:2355:x1875730518570496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836273.363494:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2355:x1875730518570624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (3338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836273.363511:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1788836273.363512:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1788836273.363536:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00080000:0.0:1788836273.363544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836273.363549:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836273.363551:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836273.363558:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518570752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836273.363587:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518570752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836273.363594:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000001:00080000:1.0:1788836273.557444:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788836273.557462:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788836273.557733:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788836273.557744:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788836273.937070:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836274.965363:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836275.024699:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538499840:0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.024780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836275.024848:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538500352:0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.024886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836275.024919:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836275.024924:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538499968:0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.024949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836275.024999:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500352 00000100:00100000:3.0:1788836275.025007:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500352 00000100:00100000:3.0:1788836275.025058:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788836275.025067:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538500352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.025120:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538500352:12345-0@lo:400:kworker.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836275.025126:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788836275.025166:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538500352:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025435:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538499712:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836275.025515:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538500224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836275.025561:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836275.025567:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538500096:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025590:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836275.025618:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500096 00000100:00100000:2.0:1788836275.025623:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500096 00000100:00100000:2.0:1788836275.025653:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836275.025661:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538500096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025701:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538500096:12345-0@lo:400:kworker.0 Request processed in 40us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836275.025706:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836275.025732:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538500096:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025748:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499840 00000100:00100000:2.0:1788836275.025751:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499840 00000100:00100000:2.0:1788836275.025769:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499968 00000100:00100000:2.0:1788836275.025780:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499968 00000100:00100000:2.0:1788836275.025793:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500224 00000100:00100000:2.0:1788836275.025795:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500224 00000100:00100000:2.0:1788836275.025805:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788836275.025810:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538499840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025856:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd078fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538499840:12345-0@lo:400:kworker.0 Request processed in 46us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836275.025861:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788836275.025871:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788836275.025875:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538499968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025895:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538499968:12345-0@lo:400:kworker.0 Request processed in 20us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836275.025899:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788836275.025907:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788836275.025911:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538500224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025932:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538500224:12345-0@lo:400:kworker.0 Request processed in 21us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836275.025937:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788836275.025956:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538500224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025972:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538499968:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.025981:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538499840:0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.026049:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538499712 00000100:00100000:3.0:1788836275.026053:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538499712 00000100:00100000:3.0:1788836275.026085:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788836275.026091:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538499712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836275.026126:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538499712:12345-0@lo:400:kworker.0 Request processed in 36us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836275.026133:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1788836275.026267:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836275.026273:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836275.026275:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836275.026613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538500480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836275.026648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836275.026793:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500480 00000100:00100000:0.0:1788836275.026798:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500480 00000100:00100000:0.0:1788836275.026843:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836275.026850:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0794e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538500480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836275.026878:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836275.026927:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0794e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538500480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836275.026933:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836275.027044:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538500480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836275.027190:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538499712:0@lo:400:kworker.0 00000100:00100000:2.0:1788836275.536792:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836275.539261:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538500608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836275.539338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836275.539513:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500608 00000100:00100000:0.0:1788836275.539522:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500608 00000100:00100000:0.0:1788836275.539585:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836275.539889:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538500608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836275.539929:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836275.540171:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ae59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538500608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836275.540244:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538500608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 649us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836275.540252:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1788836275.986080:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836277.010440:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836277.048389:0:12295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:57:53 (1788836273) 00010000:00010000:2.0:1788836278.032545:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836278.471510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836278.471557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836278.471596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836278.471626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836278.471649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836278.471697:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571520 00000100:00100000:2.0:1788836278.471707:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571520 00000100:00100000:0.0:1788836278.471712:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571264 00000100:00100000:0.0:1788836278.471716:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571264 00000100:00100000:3.0:1788836278.471758:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571008 00000100:00100000:3.0:1788836278.471762:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571008 00000100:00100000:2.0:1788836278.471781:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571136 00000100:00100000:2.0:1788836278.471784:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571136 00000100:00100000:3.0:1788836278.471790:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00100000:3.0:1788836278.471811:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518571008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836278.471895:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518571008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836278.471903:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00100000:3.0:1788836278.471935:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571392 00000100:00100000:3.0:1788836278.471938:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571392 00000100:00100000:0.0:1788836278.480513:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788836278.480532:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518571264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836278.480625:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518571264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 100us (9067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836278.480634:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788836278.480670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788836278.480679:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2356:x1875730518571520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836278.480708:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2356:x1875730518571520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (9112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836278.480715:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1788836278.486446:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:2.0:1788836278.486463:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:2356:x1875730518571136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836278.486549:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:2356:x1875730518571136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 91us (14922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836278.486557:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00080000:1.0:1788836278.487104:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836278.487110:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836278.487113:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836278.493568:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788836278.493582:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518571392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836278.493704:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2356:x1875730518571392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 125us (22052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836278.493717:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788836278.966890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836278.967123:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571776 00000100:00100000:2.0:1788836278.967133:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571776 00000100:00100000:2.0:1788836278.967193:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1788836278.967204:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+13:11315:x1875730518571776:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836278.967225:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836278.967244:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909c52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8e0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.967320:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.967334:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969513:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969538:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969545:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969802:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909c67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969812:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909c67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969818:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909c67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836278.969829:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788836278.969969:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969977:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969984:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.969989:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836278.969994:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970001:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970024:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed600) 00010000:00010000:2.0:1788836278.970027:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836278.970032:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970038:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909c59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970051:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970056:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970061:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970065:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836278.970068:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970073:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970080:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd04940b600) 00010000:00010000:2.0:1788836278.970082:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836278.970085:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.970090:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909c60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.971058:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909c52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8e0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.971078:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909c67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8e0 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836278.971085:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:2.0:1788836278.971087:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836278.971090:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998a00, rc 0) 00000100:00100000:2.0:1788836278.971161:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+15:11315:x1875730518571776:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3958us (4280us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788836278.971169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:1.0:1788836278.990421:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836278.990481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836278.990580:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572032 00000100:00100000:2.0:1788836278.990590:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572032 00000100:00100000:2.0:1788836278.990646:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1788836278.990656:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+15:11315:x1875730518572032:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788836278.990702:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518571904 00000100:00100000:0.0:1788836278.990707:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518571904 00000100:00100000:0.0:1788836278.990742:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788836278.990748:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:2354:x1875730518571904:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836278.990759:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788836278.990764:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+16:11315:x1875730518572032:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836278.990771:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00010000:00010000:0.0:1788836278.990780:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909c67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8e0 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836278.990810:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:0.0:1788836278.990816:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836278.990835:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+14:2354:x1875730518571904:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 88us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836278.990842:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:3.0:1788836279.059633:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836279.639114:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836279.639122:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836279.639160:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788836279.639167:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788836280.084185:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836280.147365:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538500864:0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.147443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836280.147494:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538501376:0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.147521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836280.147758:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538501120:0@lo:400:kworker.0 00000100:00100000:0.0:1788836280.147800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836280.147958:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538501376 00000100:00100000:0.0:1788836280.147973:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538501376 00000100:00100000:0.0:1788836280.148022:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538501120 00000100:00100000:0.0:1788836280.148025:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538501120 00000100:00100000:0.0:1788836280.148050:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836280.148058:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538501376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836280.148106:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538501376:12345-0@lo:400:kworker.0 Request processed in 48us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836280.148113:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836280.148129:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788836280.148135:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538501120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836280.148167:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538501120:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836280.148173:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836280.149675:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538500736:0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.149733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836280.150693:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538501376:0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.150734:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836280.150744:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538500992:0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.150782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836280.150828:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500864 00000100:00100000:2.0:1788836280.150834:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500864 00000100:00100000:2.0:1788836280.150869:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500992 00000100:00100000:2.0:1788836280.150872:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500992 00000100:00100000:2.0:1788836280.150897:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788836280.150906:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538500864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.150953:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538500864:12345-0@lo:400:kworker.0 Request processed in 48us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836280.150960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788836280.150975:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836280.150981:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538500992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.151005:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538500992:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836280.151011:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788836280.151035:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538500736 00000100:00100000:2.0:1788836280.151038:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538500736 00000100:00100000:2.0:1788836280.151060:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788836280.151066:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538500736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.151096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538500736:12345-0@lo:400:kworker.0 Request processed in 30us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836280.151101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788836280.151289:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538501120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.151331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538500736:0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.151339:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538501248:0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.151381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836280.151416:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538501248 00000100:00100000:3.0:1788836280.151420:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538501248 00000100:00100000:3.0:1788836280.151442:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788836280.151457:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538501248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.151503:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ae59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538501248:12345-0@lo:400:kworker.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836280.151509:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788836280.151538:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538501248:0@lo:400:kworker.0 00000100:00080000:1.0:1788836280.152316:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836280.152323:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836280.152326:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836280.152719:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538501504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836280.152763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836280.154038:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538500992:0@lo:400:kworker.0 00000100:00100000:2.0:1788836280.154062:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538500864:0@lo:400:kworker.0 00000100:00100000:3.0:1788836280.155439:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538501504 00000100:00100000:3.0:1788836280.155452:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538501504 00000100:00100000:3.0:1788836280.155525:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836280.155535:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538501504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836280.155582:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836280.155663:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538501504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836280.155688:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836280.155737:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538501504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836280.658069:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538501632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836280.660264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836280.660404:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538501632 00000100:00100000:2.0:1788836280.660416:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538501632 00000100:00100000:2.0:1788836280.660474:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836280.660484:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538501632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836280.660532:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836280.661263:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538501632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 778us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836280.661273:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836280.661364:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538501632:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836281.106755:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836281.447600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.448048:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572160 00000100:00100000:3.0:1788836281.448060:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572160 00000100:00100000:3.0:1788836281.448130:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:3.0:1788836281.448140:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+14:11358:x1875730518572160:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836281.448159:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836281.448177:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8e7 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448240:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448255:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448278:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448294:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448314:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448321:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448600:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448610:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448923:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448928:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0de00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836281.448932:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448938:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448950:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836281.448953:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.448958:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448970:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448982:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448989:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448995:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.448999:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836281.449003:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449009:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449017:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd0452e2800) 00010000:00010000:3.0:1788836281.449020:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.449023:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449029:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449062:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909c75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8e7 expref: 15 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449085:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836281.449087:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.449091:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8e7 expref: 15 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.449100:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836281.449163:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+14:11358:x1875730518572160:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1024us (1570us total) trans 0 rc 301/301 00000100:00100000:3.0:1788836281.449171:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00080000:2.0:1788836281.449471:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836281.469512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.469549:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572416 00000100:00100000:3.0:1788836281.469559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572416 00000100:00100000:3.0:1788836281.469604:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:3.0:1788836281.469870:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+14:11358:x1875730518572416:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:3.0:1788836281.469924:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836281.469949:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b9095f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a720 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.469967:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836281.469971:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836281.470144:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.470158:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.470177:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.470204:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.470217:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 5 pid: 5830 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.470232:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538501760:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836281.474006:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05431b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836281.474100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.474128:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572544 00000100:00100000:3.0:1788836281.474138:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572544 00010000:00010000:3.0:1788836281.474186:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 6 pid: 5830 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.474220:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1788836281.474230:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2354:x1875730518572544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836281.474242:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836281.474249:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 6 pid: 5830 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474261:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 6 pid: 5830 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474296:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836281.474302:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474310:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474317:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474334:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836281.474401:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2354:x1875730518572544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 172us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836281.474408:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00080000:3.0:1788836281.474433:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836281.474539:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909c4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d9 expref: 5 pid: 5830 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.474553:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538501760:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836281.474572:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474581:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.474586:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.478936:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.478970:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.478983:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836281.482499:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788836281.482517:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482529:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482537:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482543:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836281.482547:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482555:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482571:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940bc00) 00010000:00010000:3.0:1788836281.482574:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.482579:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.482585:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909c8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836281.483330:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004363057b reply state 000000003f2278c2 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.483367:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836281.483481:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+15:11358:x1875730518572416:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 13864us (13974us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788836281.483491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00010000:00010000:3.0:1788836281.494248:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494266:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494274:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494280:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836281.494285:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494292:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494322:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd0452e2800) 00010000:00010000:3.0:1788836281.494325:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.494329:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.494335:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909c91 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.640771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836281.641146:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572672 00000100:00100000:2.0:1788836281.641154:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572672 00000100:00100000:2.0:1788836281.641212:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:2.0:1788836281.641221:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+14:11366:x1875730518572672:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788836281.641245:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836281.641267:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8ee expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641330:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641382:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641413:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836281.641449:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836281.641453:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836281.641473:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641497:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8ee expref: 16 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641515:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8ee expref: 15 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.641523:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:2.0:1788836281.641526:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836281.641529:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999c00, rc 0) 00000100:00100000:2.0:1788836281.641583:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+15:11366:x1875730518572672:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 364us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836281.641590:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:3.0:1788836281.759954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836281.760065:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518572800 00000100:00100000:1.0:1788836281.760076:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518572800 00000100:00100000:1.0:1788836281.760135:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:1.0:1788836281.760146:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+15:11372:x1875730518572800:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836281.760166:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836281.760187:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760247:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760262:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760273:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760286:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760292:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760309:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760670:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760679:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760687:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836281.760712:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788836281.760716:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836281.760734:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760746:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760752:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760759:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760764:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836281.760768:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760784:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760795:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836281.760804:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836281.760810:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760816:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760829:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760835:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760840:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760846:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836281.760849:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760855:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760862:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd07a955500) 00010000:00010000:1.0:1788836281.760864:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836281.760866:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760872:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8f5 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760925:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8f5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.760933:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836281.760935:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836281.760937:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b000, rc 0) 00000100:00100000:1.0:1788836281.761013:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+16:11372:x1875730518572800:12345-192.168.203.52@tcp:101:bash.0 Request processed in 868us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836281.761021:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788836281.764231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.764572:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573056 00000100:00100000:3.0:1788836281.764583:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573056 00000100:00100000:3.0:1788836281.764639:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:3.0:1788836281.764649:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+16:11372:x1875730518573056:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836281.764671:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836281.764690:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909cc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a8fc expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764823:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764837:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764848:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764912:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764921:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.764927:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836281.767963:0:8192:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788836281.768204:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768220:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768232:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768270:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768278:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768285:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768292:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836281.768308:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768316:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768329:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836281.768333:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836281.768337:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.768361:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909cc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836281.769145:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034e83a86 reply state 00000000f8d0f8c1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836281.769157:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836281.769200:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909cc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 19 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.769215:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836281.769222:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836281.769225:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836281.769228:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0de00, rc 0) 00000100:00100000:3.0:1788836281.769884:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:11372:x1875730518573056:12345-192.168.203.52@tcp:101:bash.0 Request processed in 5233us (5660us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788836281.769893:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00010000:00010000:0.0:1788836281.777701:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777719:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777727:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777734:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836281.777739:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777746:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777792:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2800) 00010000:00010000:0.0:1788836281.777795:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836281.777800:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.777807:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b909cd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836281.779810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836281.779889:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573184 00000100:00100000:2.0:1788836281.779898:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573184 00000100:00100000:2.0:1788836281.779962:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788836281.779970:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518573184:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788836281.779985:0:12003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836281.780004:0:12003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a903 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836281.780044:0:12003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836281.780061:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1788836281.780074:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836281.780083:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 6 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.780100:0:12003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 6 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836281.780114:0:12003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998c00, rc 0) 00000100:00100000:2.0:1788836281.780415:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518573184:12345-192.168.203.52@tcp:101:bash.0 Request processed in 444us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836281.780422:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00080000:3.0:1788836281.781173:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836281.786646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836281.786803:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573312 00000100:00100000:0.0:1788836281.786813:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573312 00000100:00100000:0.0:1788836281.786871:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788836281.786881:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:11372:x1875730518573312:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836281.786899:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836281.786917:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a90a expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.786950:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.786960:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836281.786965:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836281.786970:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.787005:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.787039:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836281.787054:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875730538501888:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836281.787163:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836281.789791:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875730538501888:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836281.789826:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836281.789848:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030c00, rc 0) 00000100:00100000:0.0:1788836281.789911:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:11372:x1875730518573312:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3030us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836281.789920:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788836281.791995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836281.792104:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573440 00000100:00100000:1.0:1788836281.792113:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573440 00010000:00010000:1.0:1788836281.792150:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836281.792193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788836281.792203:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518573440:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836281.792218:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836281.792239:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.792254:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.792280:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1a7646/0xcb5b7bc40b909ce5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a903 expref: 7 pid: 12003 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.792334:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836281.792338:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836281.792817:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.792829:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.792870:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836281.792885:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875730538502016:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788836281.792973:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836281.812065:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1875730538502016:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788836281.812162:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836281.812227:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518573440:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 20025us (20240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836281.812238:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1788836281.816277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.821864:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573696 00000100:00100000:3.0:1788836281.821881:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573696 00000100:00100000:3.0:1788836281.821999:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788836281.822010:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:11372:x1875730518573696:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788836281.822419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+19:11372:x1875730518573696:12345-192.168.203.52@tcp:35:bash.0 Request processed in 410us (6151us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788836281.822427:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788836281.964729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836281.965490:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518573952 00000100:00100000:1.0:1788836281.965500:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518573952 00000100:00100000:1.0:1788836281.965569:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:1.0:1788836281.965579:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+19:11382:x1875730518573952:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836281.965603:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836281.965622:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a911 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836281.965715:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788836281.965850:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a911 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.965864:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836281.965868:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836281.965873:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a911 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836281.965888:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b200, rc 0) 00000100:00100000:1.0:1788836281.965952:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:11382:x1875730518573952:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 374us (1231us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788836281.965959:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:2.0:1788836281.972171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836281.976139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518574208 00000100:00100000:3.0:1788836281.976156:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518574208 00000100:00100000:3.0:1788836281.976229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788836281.976240:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+20:11382:x1875730518574208:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788836281.976525:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:11382:x1875730518574208:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 286us (4362us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788836281.976533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788836282.109596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.110266:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518574336 00000100:00100000:3.0:1788836282.110284:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518574336 00000100:00100000:3.0:1788836282.112005:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1788836282.112043:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:11388:x1875730518574336:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836282.112082:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836282.112121:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a918 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112214:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112231:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112247:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836282.112293:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788836282.112297:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836282.112320:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112398:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a918 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112421:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a918 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.112431:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836282.112434:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836282.112439:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836282.112534:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:11388:x1875730518574336:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 506us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836282.112543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:2.0:1788836282.130238:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836282.131211:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518574592 00000100:00100000:0.0:1788836282.131225:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518574592 00000100:00100000:0.0:1788836282.131307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1788836282.131318:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:11388:x1875730518574592:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836282.131337:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836282.131385:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909d0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a91f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.131483:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.131508:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.131519:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836282.131530:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788836282.131660:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909d0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a91f expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.131677:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a91f expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.131686:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:0.0:1788836282.131689:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836282.131692:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836282.131763:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:11388:x1875730518574592:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 446us (1609us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788836282.131770:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00010000:00010000:3.0:1788836282.138076:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836282.146597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836282.146697:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.146924:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518574976 00000100:00100000:1.0:1788836282.146937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518574976 00000100:00100000:1.0:1788836282.147025:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1788836282.147037:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:2353:x1875730518574976:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836282.147056:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836282.147098:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a91f expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.147123:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836282.147129:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836282.147199:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:2353:x1875730518574976:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 164us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836282.147226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788836282.157539:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518574848 00000100:00100000:0.0:1788836282.157563:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518574848 00000100:00100000:1.0:1788836282.157737:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:1.0:1788836282.157750:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+23:11388:x1875730518574848:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836282.157795:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836282.157821:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a926 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.157942:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.157959:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.157974:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836282.157988:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836282.158256:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a926 expref: 26 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.158277:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a926 expref: 25 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.158286:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836282.158288:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788836282.158293:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b800, rc 0) 00000100:00100000:1.0:1788836282.158670:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+25:11388:x1875730518574848:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 921us (12086us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788836282.158707:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:2.0:1788836282.168335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836282.168536:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575104 00000100:00100000:0.0:1788836282.168549:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575104 00000100:00100000:0.0:1788836282.168615:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788836282.168627:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518575104:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:0.0:1788836282.168682:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.168724:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.168734:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788836282.168739:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836282.168744:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.168802:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.168818:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 6 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836282.168834:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538502144:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836282.168954:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836282.171560:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875730538502144:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836282.171599:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836282.178390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.179004:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575232 00000100:00100000:3.0:1788836282.179018:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575232 00002000:00100000:3.0:1788836282.179092:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bd04674f100 x1875730518575232/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:448/0 lens 504/0 e 0 to 0 dl 1788836293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836282.179105:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd04674f100 with x1875730518575232 ext(0->12) 00010000:00010000:3.0:1788836282.179116:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 7 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.179159:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 7 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836282.179168:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd04674f100 00000100:00100000:3.0:1788836282.179210:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836282.179222:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518575232:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:3.0:1788836282.181427:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518575232:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 2191us (3081us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788836282.181444:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:3.0:1788836282.181458:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bd04674f100 x1875730518575232/t4294967305(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:448/0 lens 504/448 e 0 to 0 dl 1788836293 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836282.181472:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd04674f100 with x1875730518575232 ext(0->12) 00010000:00010000:3.0:1788836282.181495:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.181518:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836282.181535:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bd04674f100 00000100:00100000:0.0:1788836282.202847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.203069:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575360 00000100:00100000:1.0:1788836282.203084:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575360 00010000:00010000:1.0:1788836282.203136:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836282.203188:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788836282.203200:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2353:x1875730518575360:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836282.203219:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788836282.203243:0:5814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788836282.203247:0:5814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788836280 00002000:00010000:1.0:1788836282.203250:0:5814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788836280 00002000:00010000:1.0:1788836282.203252:0:5814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788836280 00010000:00010000:1.0:1788836282.203259:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.203275:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.203305:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b909cec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a90a expref: 9 pid: 6683 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.203326:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836282.203331:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836282.203338:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.203431:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.203472:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836282.203538:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518575360:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 339us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836282.203546:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00010000:00010000:0.0:1788836282.203583:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203594:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203634:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203662:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203670:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203678:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836282.203682:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203691:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203704:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.203712:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccba8958/0xcb5b7bc40b909d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836282.203793:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518575104:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 35168us (35472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836282.203803:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788836282.210580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.210822:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575616 00000100:00100000:3.0:1788836282.210836:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575616 00000100:00100000:3.0:1788836282.210917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788836282.210930:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:11388:x1875730518575616:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788836282.211039:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a926 expref: 25 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836282.211396:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788836282.211443:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788836282.217435:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788836282.217566:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.217592:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 29 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.217603:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.217654:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 29 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.217672:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 29 pid: 8192 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836282.217690:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875730538502272:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836282.217827:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05431b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836282.224101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.224288:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1875730538502272:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836282.224328:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836282.227529:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575744 00000100:00100000:1.0:1788836282.227552:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575744 00010000:00010000:1.0:1788836282.227619:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 30 pid: 8192 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836282.227674:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1788836282.227685:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047941850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+30:2353:x1875730518575744:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836282.227705:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836282.227713:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 30 pid: 8192 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227728:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 30 pid: 8192 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227756:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b909cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8fc expref: 30 pid: 8192 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227788:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836282.227812:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227823:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227831:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.227881:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836282.227964:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047941850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+29:2353:x1875730518575744:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 280us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836282.227974:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00010000:00010000:3.0:1788836282.228836:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.228863:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836282.229025:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788836282.230236:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788836282.230435:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538502400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788836282.230518:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836282.231830:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05072ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836282.236299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538502400 00000100:00100000:0.0:1788836282.236317:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538502400 00000100:00100000:1.0:1788836282.244537:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836282.244554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538502400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788836282.244720:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538502400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (14202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836282.244729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836282.244875:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538502400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788836282.247835:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788836282.247979:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538502528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788836282.248623:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836282.248665:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05431b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836282.248756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538502528 00000100:00100000:0.0:1788836282.248767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538502528 00000100:00100000:0.0:1788836282.248847:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836282.248858:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875730538502528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788836282.249130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875730538502528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 273us (509us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788836282.249139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836282.249398:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1875730538502528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788836282.249484:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788836282.250300:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250314:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250323:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250330:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836282.250334:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250388:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250409:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836282.250412:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788836282.250418:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.250424:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909d40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836282.251460:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788836282.251629:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788836282.251766:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788836282.251793:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335386449056ns, next at 336386445321ns, rc = 0 00000001:00080000:3.0:1788836282.251806:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788836282.251866:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836282.251870:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788836282.251882:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b909d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a926 expref: 33 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836282.252037:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:11388:x1875730518575616:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 41109us (41470us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788836282.252049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000020:00080000:3.0:1788836282.252056:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788836282.255463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836282.255765:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518575872 00000100:00100000:0.0:1788836282.255789:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518575872 00000100:00100000:0.0:1788836282.255863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1788836282.255874:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:11388:x1875730518575872:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836282.255906:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836282.255935:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a92d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.256009:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a92d expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.256027:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a92d expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.256048:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836282.256051:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836282.256055:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820da200, rc 0) 00000100:00100000:0.0:1788836282.256128:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:11388:x1875730518575872:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 256us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836282.256136:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:2.0:1788836282.259561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.259750:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518576128 00000100:00100000:1.0:1788836282.259763:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518576128 00000100:00100000:1.0:1788836282.259843:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788836282.259854:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+33:11388:x1875730518576128:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836282.260188:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+34:11388:x1875730518576128:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 335us (640us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788836282.260197:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788836282.381402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.381687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518576384 00000100:00100000:3.0:1788836282.381701:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518576384 00000100:00100000:3.0:1788836282.381789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:3.0:1788836282.381803:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+34:11398:x1875730518576384:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836282.381848:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836282.382253:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a934 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836282.382722:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788836282.382996:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909d4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a934 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.383015:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836282.383019:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836282.383024:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a934 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.383041:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836282.383244:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+35:11398:x1875730518576384:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1443us (1855us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788836282.383253:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1788836282.387739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836282.388279:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518576512 00000100:00100000:0.0:1788836282.388294:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518576512 00000100:00100000:0.0:1788836282.388478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:0.0:1788836282.388500:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+35:11398:x1875730518576512:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788836282.388616:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.388755:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.388838:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.389452:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.389465:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.389475:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.389856:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.390605:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.390619:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836282.390951:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.390995:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391002:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391009:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391017:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836282.391022:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391030:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391045:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836282.391048:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836282.391054:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391285:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391308:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391314:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391321:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.391332:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820dbc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836282.391335:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392250:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392278:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0498eda00) 00010000:00010000:0.0:1788836282.392281:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836282.392286:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392293:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392319:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392326:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392332:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392338:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836282.392371:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392379:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392406:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836282.392409:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836282.392412:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836282.392418:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836282.392568:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+35:11398:x1875730518576512:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 4073us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836282.392580:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1788836282.395905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.396162:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518576768 00000100:00100000:3.0:1788836282.396176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518576768 00000100:00100000:3.0:1788836282.396255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788836282.396267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+35:11398:x1875730518576768:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836282.397235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+36:11398:x1875730518576768:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 965us (1337us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788836282.397247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788836282.456091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.456402:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518577024 00000100:00100000:1.0:1788836282.456417:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518577024 00000100:00100000:1.0:1788836282.456496:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:1.0:1788836282.456524:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+36:11401:x1875730518577024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836282.456568:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836282.456594:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909d71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a93b expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456715:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456733:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456748:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456765:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456783:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456790:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456940:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456950:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.456957:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836282.456979:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836282.457109:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457118:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457125:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457132:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978be00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836282.457137:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457146:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457163:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836282.457166:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836282.457173:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457179:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457195:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457202:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457220:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457226:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836282.457229:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457237:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457245:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd07a955500) 00010000:00010000:1.0:1788836282.457247:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836282.457250:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457256:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457303:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909d71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 39 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457317:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 38 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.457324:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836282.457326:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836282.457329:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a600, rc 0) 00000100:00100000:1.0:1788836282.457489:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+38:11401:x1875730518577024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 968us (1427us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788836282.457508:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:3.0:1788836282.461668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.461762:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518577152 00000100:00100000:1.0:1788836282.461784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518577152 00000100:00100000:1.0:1788836282.461871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1788836282.461884:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+38:11401:x1875730518577152:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788836282.461982:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462002:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462016:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462049:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462057:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462065:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462072:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836282.462077:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462086:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462099:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836282.462119:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836282.462126:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.462133:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836282.462226:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+38:11401:x1875730518577152:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 344us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836282.462234:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:0.0:1788836282.467271:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836282.467682:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518577408 00000100:00100000:2.0:1788836282.467696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518577408 00000100:00100000:2.0:1788836282.467779:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788836282.467792:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+38:11401:x1875730518577408:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836282.468297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+39:11401:x1875730518577408:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 505us (1037us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788836282.468305:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000040:00080000:0.0:1788836282.704693:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836282.704706:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836282.705119:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788836282.705128:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836282.800239:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.804092:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518577664 00000100:00100000:1.0:1788836282.804118:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518577664 00000100:00100000:1.0:1788836282.804218:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:1.0:1788836282.804232:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+39:11432:x1875730518577664:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1788836282.804267:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836282.804296:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a942 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.804456:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.804475:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.804490:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836282.804503:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836282.806263:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a942 expref: 42 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.806323:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a942 expref: 41 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.806334:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836282.806337:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836282.806450:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b200, rc 0) 00000100:00100000:1.0:1788836282.806556:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07accaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+41:11432:x1875730518577664:12345-192.168.203.52@tcp:101:cat.0 Request processed in 2325us (6330us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788836282.806565:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:3.0:1788836282.820134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836282.822310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.822981:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518578048 00000100:00100000:3.0:1788836282.822998:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518578048 00000100:00100000:3.0:1788836282.823201:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788836282.823214:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+41:2354:x1875730518578048:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836282.823259:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836282.823294:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a942 expref: 41 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.823319:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836282.823324:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836282.823451:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+40:2354:x1875730518578048:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 238us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836282.823459:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836282.826367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518577920 00000100:00100000:2.0:1788836282.826385:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518577920 00000100:00100000:0.0:1788836282.826598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788836282.826611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+40:11432:x1875730518577920:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1788836282.827761:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+41:11432:x1875730518577920:12345-192.168.203.52@tcp:35:cat.0 Request processed in 1141us (7631us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788836282.827785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788836282.955519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836282.955639:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518578304 00000100:00100000:1.0:1788836282.955652:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518578304 00000100:00100000:1.0:1788836282.955729:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788836282.955741:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+41:11438:x1875730518578304:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788836282.955784:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836282.955788:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836282.955827:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b909d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a918 expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.955852:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836282.955871:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836282.955890:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a949 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.956491:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.956532:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 41 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.956543:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.956585:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 41 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.956603:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 41 pid: 8192 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836282.956619:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538502656:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836282.956760:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836282.964642:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538502656:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836282.964683:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836282.965588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836282.965943:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518578432 00000100:00100000:2.0:1788836282.965955:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518578432 00010000:00010000:2.0:1788836282.966015:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 42 pid: 8192 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836282.966070:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788836282.966083:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+42:2354:x1875730518578432:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836282.966103:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836282.966111:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 42 pid: 8192 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966152:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 42 pid: 8192 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966181:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a93b expref: 42 pid: 8192 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966200:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:2.0:1788836282.966206:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966217:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966226:0:8494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836282.966262:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836282.966386:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+41:2354:x1875730518578432:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 261us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836282.966395:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:1.0:1788836282.967021:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.967034:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836282.967068:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788836282.967276:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.967314:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836282.967324:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836282.967327:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836282.967330:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ae00, rc 0) 00000100:00100000:1.0:1788836282.967437:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+41:11438:x1875730518578304:12345-192.168.203.52@tcp:101:dd.0 Request processed in 11698us (11931us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788836282.967447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:0.0:1788836282.978845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836282.981047:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518578688 00000100:00100000:3.0:1788836282.981066:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518578688 00000100:00100000:3.0:1788836282.981172:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:3.0:1788836282.981184:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+41:11438:x1875730518578688:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:3.0:1788836282.981624:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.981646:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.981661:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836282.981719:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788836282.981746:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a7d2342 reply state 00000000899d5298 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836282.981757:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836282.984393:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+44:11438:x1875730518578688:12345-192.168.203.52@tcp:36:dd.0 Request processed in 3192us (5545us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788836282.984438:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000020:00080000:3.0:1788836282.984449:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836282.995945:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.995968:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.995978:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.996632:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836282.996642:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.996728:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.996753:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836282.996757:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836282.996764:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836282.996781:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.155073:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836283.296120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.296387:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518578816 00000100:00100000:1.0:1788836283.296402:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518578816 00000100:00100000:1.0:1788836283.296502:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:1.0:1788836283.296517:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+43:11452:x1875730518578816:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1788836283.296558:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836283.296586:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a950 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296685:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296703:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296722:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296746:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296782:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296793:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296924:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296938:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296948:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.296987:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.297006:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 44 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836283.297021:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538502784:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836283.297148:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836283.300129:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a724700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538502784:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836283.300172:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836283.301382:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836283.309335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.310821:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579072 00000100:00100000:1.0:1788836283.310854:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579072 00000100:00100000:1.0:1788836283.310943:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788836283.310954:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+45:5590:x1875730518579072:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788836283.312332:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+46:5590:x1875730518579072:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 1369us (3001us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788836283.312814:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788836283.323935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.324048:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579200 00000100:00100000:1.0:1788836283.324061:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579200 00010000:00010000:1.0:1788836283.324110:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 46 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836283.324161:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1788836283.324171:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+46:2354:x1875730518579200:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836283.324190:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836283.324198:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 46 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324212:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 46 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324238:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909db7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a949 expref: 46 pid: 5831 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324257:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836283.324263:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324295:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324305:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.324398:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836283.324460:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+45:2354:x1875730518579200:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 290us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836283.324468:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00010000:00010000:0.0:1788836283.325130:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325141:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836283.325201:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788836283.325214:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836283.325245:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325261:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325271:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325278:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325286:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325293:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978be00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836283.325298:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325307:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325319:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836283.325322:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836283.325326:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325435:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978be00/0xcb5b7bc40b909dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325452:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325458:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325465:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325470:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836283.325473:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325480:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325489:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd07a955500) 00010000:00010000:0.0:1788836283.325492:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836283.325494:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325500:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b909dda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325918:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b909dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a950 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325936:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a950 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.325952:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836283.325955:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836283.325958:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978bc00, rc 0) 00000100:00100000:0.0:1788836283.326068:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+44:11452:x1875730518578816:12345-192.168.203.52@tcp:101:stat.0 Request processed in 29556us (29963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836283.326077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1788836283.422559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.423256:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579456 00000100:00100000:1.0:1788836283.423269:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579456 00000100:00100000:1.0:1788836283.423340:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:1.0:1788836283.423381:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+44:11458:x1875730518579456:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:1.0:1788836283.423459:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836283.423490:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b909de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a950 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.423511:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836283.423517:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836283.423982:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.423999:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.424010:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836283.424338:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788836283.424434:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052b9ee16 reply state 0000000063dd9e63 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836283.424444:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836283.424586:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+46:11458:x1875730518579456:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 1206us (2038us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788836283.424595:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000020:00080000:1.0:1788836283.424600:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788836283.430910:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430927:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430935:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430941:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ae00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836283.430946:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430952:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430970:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836283.430973:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836283.430978:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836283.430983:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b909de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836283.593596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836283.593648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836283.593682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836283.593722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.593756:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579840 00000100:00100000:0.0:1788836283.593776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836283.593784:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579840 00000100:00100000:0.0:1788836283.593809:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579968 00000100:00100000:0.0:1788836283.593821:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579968 00000100:00100000:1.0:1788836283.593889:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1788836283.593902:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518579840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836283.593940:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579584 00000100:00100000:2.0:1788836283.593948:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579584 00000100:00100000:2.0:1788836283.593994:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00100000:2.0:1788836283.594005:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518579584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836283.594029:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518579840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836283.594106:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518580096 00000100:00100000:3.0:1788836283.594114:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518580096 00000100:00100000:3.0:1788836283.594147:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518579712 00000100:00100000:3.0:1788836283.594162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518579712 00000100:00100000:3.0:1788836283.594185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:3.0:1788836283.594191:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518580096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836283.594256:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518579584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 253us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836283.594272:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00100000:2.0:1788836283.594363:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:2.0:1788836283.594382:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+45:2355:x1875730518579712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836283.594880:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788836283.594892:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518579968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836283.596550:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00080000:1.0:1788836283.597885:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836283.597898:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836283.597902:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836283.602157:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2355:x1875730518580096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7955us (8464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836283.602170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:2.0:1788836283.604898:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+45:2355:x1875730518579712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 10505us (11163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836283.604912:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:1.0:1788836283.609908:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:2355:x1875730518579968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 14494us (15622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836283.609928:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1788836283.789262:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836283.789295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518580224 00000100:00100000:3.0:1788836283.789320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518580224 00000100:00100000:3.0:1788836283.789387:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:3.0:1788836283.789398:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+45:11472:x1875730518580224:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:3.0:1788836283.789418:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836283.789438:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909def lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a957 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789504:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789529:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789548:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789562:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789568:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789591:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789877:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789887:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789895:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836283.789928:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788836283.789932:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836283.789956:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789968:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789975:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789982:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789988:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.789995:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836283.789999:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790013:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790026:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836283.790029:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836283.790034:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790040:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790052:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790058:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790064:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790069:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836283.790072:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790077:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790084:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836283.790086:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836283.790089:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790103:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790136:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909def lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790149:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.790156:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836283.790158:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836283.790161:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d800, rc 0) 00000100:00100000:3.0:1788836283.790222:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+46:11472:x1875730518580224:12345-192.168.203.52@tcp:101:stat.0 Request processed in 826us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836283.790245:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00000001:00080000:2.0:1788836283.811012:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788836283.811032:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788836283.823262:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000001:00080000:1.0:1788836283.823284:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:1.0:1788836283.823461:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788836283.823486:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd05431b0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788836283.823491:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048b76b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0586dca80 00000020:00080000:1.0:1788836283.823508:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd0516c6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd0797a5400 00000100:00100000:3.0:1788836283.823731:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538502912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788836283.823804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836283.824036:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538502912 00000100:00100000:1.0:1788836283.824043:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538502912 00000100:00100000:1.0:1788836283.824157:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836283.824167:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538502912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788836283.824192:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788836283.824224:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f79b8, atime: 0x6a9f79b8, ctime: 0x6a9f79b8, blocks: 0xb 00010000:00010000:1.0:1788836283.824232:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.824248:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788836283.824252:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836283.824259:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.824275:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.824284:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836283.824292:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788836283.824457:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788836283.824706:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788836283.824829:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836283.825462:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836283.825470:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836283.825482:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836283.825487:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836283.825496:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836283.825514:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836283.825531:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e5c522/0xcb5b7bc40b909e0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836283.825663:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836283.825665:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836283.825667:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836283.826089:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538502912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1920us (2282us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788836283.826105:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836283.826176:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788836283.826182:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788836283.826206:0:3303:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd07ad1ca80 x1875730538502912/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788836299 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788836283.826217:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07ad1ca80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788836283.826222:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538502912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788836283.887263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836283.887395:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518580480 00000100:00100000:3.0:1788836283.887405:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518580480 00000100:00100000:3.0:1788836283.887467:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1788836283.887485:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+16:11482:x1875730518580480:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836283.887506:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836283.887525:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a95e expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836283.887631:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788836283.887843:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a95e expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.887857:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836283.887860:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836283.887864:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a95e expref: 18 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836283.887877:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0da00, rc 0) 00000100:00100000:3.0:1788836283.887941:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+17:11482:x1875730518580480:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 458us (688us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788836283.887948:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1788836283.892385:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836283.892467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518580736 00000100:00100000:0.0:1788836283.892477:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518580736 00000100:00100000:0.0:1788836283.892533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788836283.892561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:11482:x1875730518580736:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836283.892804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:11482:x1875730518580736:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 261us (467us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788836283.892811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788836284.004165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.004254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518580992 00000100:00100000:3.0:1788836284.004265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518580992 00000100:00100000:3.0:1788836284.004327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:3.0:1788836284.004337:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+18:11488:x1875730518580992:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836284.004455:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836284.004487:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a965 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.004811:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.004828:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.004837:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.004873:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.004887:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 19 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.004900:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538503040:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836284.005043:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0494279c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836284.009485:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.009797:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518581120 00000100:00100000:0.0:1788836284.009807:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518581120 00010000:00010000:0.0:1788836284.009845:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 20 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836284.009892:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788836284.009903:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+20:2354:x1875730518581120:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836284.009919:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836284.009946:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 20 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.009959:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 20 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.009982:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836284.009986:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.009995:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.010002:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.010020:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836284.010089:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+20:2354:x1875730518581120:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 187us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836284.010096:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00010000:00010000:3.0:1788836284.013414:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a957 expref: 19 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.013440:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad01500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538503040:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836284.013474:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.013483:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.013509:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836284.013774:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788836284.014337:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.014403:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.014413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836284.014416:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836284.014419:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836284.014785:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:11488:x1875730518580992:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10447us (10640us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788836284.014794:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:1.0:1788836284.020448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.020816:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518581376 00000100:00100000:3.0:1788836284.020825:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518581376 00000100:00100000:3.0:1788836284.022182:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:3.0:1788836284.022211:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:11488:x1875730518581376:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788836284.023201:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.023221:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.023232:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836284.023288:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788836284.023325:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b835f907 reply state 0000000035ceb34a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836284.023334:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836284.023466:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+22:11488:x1875730518581376:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1263us (3026us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788836284.023475:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000020:00080000:2.0:1788836284.023480:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836284.025980:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.025997:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.026004:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.026025:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.026030:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.026038:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.026053:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836284.026057:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.026061:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.026067:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836284.047586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.048137:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518581504 00000100:00100000:0.0:1788836284.048149:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518581504 00000100:00100000:0.0:1788836284.048245:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1788836284.048257:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:11488:x1875730518581504:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836284.048281:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836284.048299:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909e3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a96c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.048402:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.048430:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.048440:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.048474:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.048487:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 22 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836284.048500:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538503168:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836284.048614:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836284.052730:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538503168:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836284.052770:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836284.055391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.055469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518581632 00000100:00100000:0.0:1788836284.055478:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518581632 00010000:00010000:0.0:1788836284.055527:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 23 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836284.055571:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788836284.055581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:2354:x1875730518581632:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836284.055596:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836284.055615:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 23 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055627:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 23 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055650:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b909e27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a965 expref: 23 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055665:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836284.055670:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055679:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055688:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.055718:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836284.055783:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:2354:x1875730518581632:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 203us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836284.055791:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:3.0:1788836284.056004:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.056012:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836284.056066:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788836284.056071:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836284.056092:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.056121:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030c00/0xcb5b7bc40b909e3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a96c expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.056135:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a96c expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.056148:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836284.056151:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836284.056154:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031600, rc 0) 00000100:00100000:3.0:1788836284.056192:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:11488:x1875730518581504:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7937us (8616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836284.056199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:1.0:1788836284.060881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.061271:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518581888 00000100:00100000:0.0:1788836284.061283:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518581888 00000100:00100000:0.0:1788836284.061362:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788836284.061373:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:11488:x1875730518581888:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788836284.061787:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+22:11488:x1875730518581888:12345-192.168.203.52@tcp:35:bash.0 Request processed in 415us (916us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788836284.061810:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00010000:00010000:3.0:1788836284.176581:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836284.189968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.190151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518582144 00000100:00100000:2.0:1788836284.190162:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518582144 00000100:00100000:2.0:1788836284.190221:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1788836284.190230:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:11498:x1875730518582144:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836284.190254:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836284.190275:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a973 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836284.190417:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788836284.190536:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909e4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a973 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.190550:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:2.0:1788836284.190553:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836284.190557:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a973 expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.190570:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998000, rc 0) 00000100:00100000:2.0:1788836284.190631:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:11498:x1875730518582144:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 402us (675us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788836284.190638:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1788836284.195281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.195536:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518582272 00000100:00100000:3.0:1788836284.195547:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518582272 00000100:00100000:3.0:1788836284.195606:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:3.0:1788836284.195616:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:11498:x1875730518582272:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788836284.195690:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.195707:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.195720:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.195735:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.195743:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.195749:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196076:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196085:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196092:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836284.196135:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196148:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196154:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196160:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196178:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.196183:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196191:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196202:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836284.196205:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.196209:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196221:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909e58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196234:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196240:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196245:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196250:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.196252:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196258:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196265:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836284.196267:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.196270:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196287:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196293:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.196302:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.197299:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.197315:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.197323:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.197336:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:3.0:1788836284.197339:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.197357:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.197364:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.197506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:11498:x1875730518582272:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1889us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836284.197524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:1.0:1788836284.209664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.209864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518582528 00000100:00100000:3.0:1788836284.209874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518582528 00000100:00100000:3.0:1788836284.209963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788836284.209974:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:11498:x1875730518582528:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788836284.210230:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:11498:x1875730518582528:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 256us (573us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788836284.210238:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788836284.266401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.266485:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518582784 00000100:00100000:2.0:1788836284.266495:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518582784 00000100:00100000:2.0:1788836284.266563:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788836284.266573:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:11501:x1875730518582784:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836284.266598:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836284.266620:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a97a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266700:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266715:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266741:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266756:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266773:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.266780:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267200:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267211:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267219:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836284.267229:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788836284.267314:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267321:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267328:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267335:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836284.267375:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267383:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267396:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836284.267399:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836284.267403:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267409:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b909e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267421:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267428:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267433:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267438:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836284.267441:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267446:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267452:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd04940be00) 00010000:00010000:2.0:1788836284.267454:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836284.267464:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267470:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267769:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b909e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a97a expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267789:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a97a expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.267797:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:2.0:1788836284.267800:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836284.267802:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836284.267997:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+26:11501:x1875730518582784:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1425us (1654us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788836284.268006:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788836284.272428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.272478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.272675:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518582912 00000100:00100000:0.0:1788836284.272685:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518582912 00000100:00100000:0.0:1788836284.272739:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:0.0:1788836284.272749:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:11501:x1875730518582912:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788836284.272826:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272844:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272856:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272894:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272900:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272906:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272912:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820db200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836284.272917:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272923:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272955:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:0.0:1788836284.272958:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836284.272962:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.272968:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836284.273048:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:11501:x1875730518582912:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 299us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836284.273056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:1.0:1788836284.273850:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518583040 00000100:00100000:1.0:1788836284.273871:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518583040 00000100:00100000:1.0:1788836284.273913:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788836284.273922:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+26:2356:x1875730518583040:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836284.273934:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836284.273952:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a97a expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.273968:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836284.273971:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836284.274011:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+25:2356:x1875730518583040:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 91us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.274018:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788836284.277131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.277255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518583296 00000100:00100000:3.0:1788836284.277264:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518583296 00000100:00100000:3.0:1788836284.277324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788836284.277334:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:11501:x1875730518583296:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788836284.277824:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:11501:x1875730518583296:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 490us (701us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788836284.277832:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788836284.459719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.459843:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518583552 00000100:00100000:1.0:1788836284.459852:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518583552 00000100:00100000:1.0:1788836284.459914:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:1.0:1788836284.459925:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+26:11519:x1875730518583552:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1788836284.459951:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.459994:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909e97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a981 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.460086:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909e9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.460100:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909e9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.460112:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909e9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836284.460122:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788836284.460254:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909e97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a981 expref: 29 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.460275:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909e9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a981 expref: 28 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.460282:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:1.0:1788836284.460285:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788836284.460288:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836284.460403:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+28:11519:x1875730518583552:12345-192.168.203.52@tcp:101:cat.0 Request processed in 480us (694us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788836284.460410:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:2.0:1788836284.491279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.491476:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518583680 00000100:00100000:0.0:1788836284.491486:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518583680 00000100:00100000:0.0:1788836284.491555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:0.0:1788836284.491566:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:11520:x1875730518583680:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836284.491589:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836284.491608:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a988 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491674:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491688:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491698:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836284.491734:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788836284.491751:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836284.491784:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491812:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a988 expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491833:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a988 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.491842:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836284.491844:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836284.491848:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd0820dbc00, rc 0) 00000100:00100000:0.0:1788836284.491915:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:11520:x1875730518583680:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 350us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836284.491922:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:3.0:1788836284.514035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.514297:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584064 00000100:00100000:2.0:1788836284.514315:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584064 00000100:00100000:2.0:1788836284.514400:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788836284.514411:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:11520:x1875730518584064:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836284.515145:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+30:11520:x1875730518584064:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 734us (1117us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788836284.515380:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1788836284.525110:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.525660:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584192 00000100:00100000:2.0:1788836284.525671:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584192 00000100:00100000:2.0:1788836284.525734:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836284.525744:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047943050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+30:11520:x1875730518584192:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:2.0:1788836284.525769:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788836284.525793:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031600/0xcb5b7bc40b909e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a96c expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.525814:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909e9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a981 expref: 29 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.525826:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a92d expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.525838:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0498ed400) 00010000:00010000:2.0:1788836284.525848:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836284.526659:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047943050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+27:11520:x1875730518584192:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 910us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836284.526669:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788836284.533267:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.533376:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584320 00000100:00100000:2.0:1788836284.533386:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584320 00000100:00100000:2.0:1788836284.533445:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:2.0:1788836284.533455:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+27:11520:x1875730518584320:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1788836284.533610:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.533637:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.533649:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836284.533984:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788836284.534844:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+27:11520:x1875730518584320:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 1386us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836284.534855:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788836284.595568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.595727:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584448 00000100:00100000:0.0:1788836284.595737:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584448 00000100:00100000:0.0:1788836284.595809:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:0.0:1788836284.595821:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:11522:x1875730518584448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836284.595842:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836284.595872:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a98f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.595935:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.595949:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.595972:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.595998:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596005:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596012:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596286:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596305:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836284.596336:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788836284.596381:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836284.596401:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596413:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596421:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596437:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596444:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596450:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0820da200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836284.596455:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596462:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596475:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836284.596478:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836284.596482:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596489:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da200/0xcb5b7bc40b909ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596503:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596509:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596515:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596521:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836284.596778:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596787:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596796:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0498edd00) 00010000:00010000:0.0:1788836284.596798:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836284.596802:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596808:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b909ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596843:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820db200/0xcb5b7bc40b909ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596966:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836284.596976:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:0.0:1788836284.596979:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836284.596982:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217dc00, rc 0) 00000100:00100000:0.0:1788836284.597205:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:11522:x1875730518584448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1385us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836284.597212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00000040:00080000:3.0:1788836284.755946:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836284.755955:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836284.755995:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788836284.756001:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836284.756176:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0412a9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538503296:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836284.756616:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836284.782861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.783019:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584576 00000100:00100000:1.0:1788836284.783028:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584576 00000100:00100000:1.0:1788836284.783089:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:1.0:1788836284.783103:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518584576:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788836284.783148:0:8192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788836284.783261:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518584576:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 163us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.783268:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:0.0:1788836284.783607:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0412a9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538503296:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836284.787287:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.787491:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584704 00000100:00100000:3.0:1788836284.787502:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584704 00000100:00100000:3.0:1788836284.787668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:3.0:1788836284.787678:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+28:11533:x1875730518584704:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788836284.787745:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787771:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787782:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787812:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787820:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787826:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787851:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787859:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787866:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836284.787904:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788836284.787908:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788836284.787921:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787931:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787938:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787945:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787960:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.787965:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787973:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787985:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:3.0:1788836284.787988:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.787992:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.787998:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909edd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788010:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788016:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788021:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788025:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.788028:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788034:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788052:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836284.788055:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.788058:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788063:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909ee4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788076:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788082:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788087:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788092:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836284.788095:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788099:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788105:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:3.0:1788836284.788106:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836284.788109:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.788114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.788424:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+28:11533:x1875730518584704:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 746us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836284.788433:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:1.0:1788836284.806849:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.806898:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518584960 00000100:00100000:1.0:1788836284.806908:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518584960 00000100:00100000:1.0:1788836284.806956:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:1.0:1788836284.806966:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+28:11533:x1875730518584960:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.806988:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.807010:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909ef2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a996 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807115:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807128:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807139:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836284.807150:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788836284.807243:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807250:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807268:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807274:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978aa00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836284.807278:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807286:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807298:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:1.0:1788836284.807301:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836284.807305:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807311:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807376:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909ef2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a996 expref: 30 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807387:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:1.0:1788836284.807389:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836284.807393:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909ef2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a996 expref: 30 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.807403:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ba00, rc 0) 00000100:00100000:1.0:1788836284.807455:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518584960:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 490us (617us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788836284.807469:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:1.0:1788836284.811733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.811833:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518585088 00000100:00100000:2.0:1788836284.811843:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518585088 00000100:00100000:2.0:1788836284.811905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:2.0:1788836284.811914:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518585088:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836284.811949:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836284.812051:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518585088:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 138us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836284.812059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:0.0:1788836284.823046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.827166:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518585344 00000100:00100000:1.0:1788836284.827181:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518585344 00000100:00100000:1.0:1788836284.827386:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:1.0:1788836284.827398:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518585344:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.827418:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.827421:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788836284.827447:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dbc00/0xcb5b7bc40b909eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a988 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.827466:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836284.827471:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836284.827483:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909f07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a99d expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836284.828229:0:8192:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788836284.828522:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909f0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.828537:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.828547:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909f0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.828604:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909f07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a99d expref: 31 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.828633:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909f0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a99d expref: 30 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.828641:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955900) 00010000:00010000:1.0:1788836284.828644:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836284.828646:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836284.828717:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+30:11533:x1875730518585344:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1322us (5677us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788836284.828725:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:3.0:1788836284.834299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.834977:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518585600 00000100:00100000:2.0:1788836284.834988:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518585600 00000100:00100000:2.0:1788836284.835059:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:2.0:1788836284.835069:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+30:11533:x1875730518585600:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836284.835126:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836284.835153:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b909f0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a99d expref: 30 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835182:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955900) 00010000:00010000:2.0:1788836284.835192:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836284.835214:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835227:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835237:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835252:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835259:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835265:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835472:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835479:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835486:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835491:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836284.835495:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835687:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835699:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836284.835702:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836284.835706:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835712:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b909f1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835722:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835727:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835732:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835737:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836284.835740:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835745:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835752:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x90f954ee (ffff9bd04940bb00) 00010000:00010000:2.0:1788836284.835765:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836284.835769:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.835785:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x90f954ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836284.835883:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518585600:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 815us (1593us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836284.835892:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:1.0:1788836284.842898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.842933:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518585728 00000100:00100000:1.0:1788836284.842942:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518585728 00000100:00100000:1.0:1788836284.842989:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:1.0:1788836284.843001:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+29:11533:x1875730518585728:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.843021:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.843042:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9a4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843093:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843107:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843119:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843224:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843241:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.843250:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:1.0:1788836284.843253:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836284.843257:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b600, rc 0) 00000100:00100000:1.0:1788836284.843309:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+30:11533:x1875730518585728:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 311us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.843318:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:2.0:1788836284.847397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.847469:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518585984 00000100:00100000:1.0:1788836284.847478:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518585984 00000100:00100000:1.0:1788836284.847545:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:1.0:1788836284.847555:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+30:11533:x1875730518585984:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.847634:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.847651:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.847663:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836284.847937:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788836284.847946:0:8192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337982602751ns, next at 338982600758ns, rc = 0 00000004:00010000:1.0:1788836284.848038:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f6b4d6f reply state 0000000098f6e64a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836284.848062:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836284.848158:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+32:11533:x1875730518585984:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 604us (771us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788836284.848164:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 178 00010000:00010000:2.0:1788836284.850729:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850745:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850751:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850769:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836284.850773:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850781:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850800:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:2.0:1788836284.850802:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788836284.850807:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836284.850812:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b200/0xcb5b7bc40b909f38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836284.851439:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.851744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518586112 00000100:00100000:1.0:1788836284.851762:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518586112 00000100:00100000:1.0:1788836284.851812:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:1.0:1788836284.851821:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+31:11533:x1875730518586112:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.851841:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.851858:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9ab expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.851912:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.851927:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.851945:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:1.0:1788836284.851948:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836284.851951:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a000, rc 0) 00000100:00100000:1.0:1788836284.852001:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+32:11533:x1875730518586112:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 181us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.852008:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:0.0:1788836284.855264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.855520:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518586240 00000100:00100000:3.0:1788836284.855829:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518586240 00000100:00100000:3.0:1788836284.855877:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788836284.855887:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518586240:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788836284.856328:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518586240:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 441us (1071us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788836284.856337:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788836284.859693:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.859798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518586496 00000100:00100000:0.0:1788836284.859809:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518586496 00000100:00100000:0.0:1788836284.859869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788836284.859879:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:11533:x1875730518586496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788836284.860223:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+33:11533:x1875730518586496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 344us (542us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788836284.860231:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788836284.869291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.869383:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518586752 00000100:00100000:2.0:1788836284.869392:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518586752 00000100:00100000:2.0:1788836284.869449:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:2.0:1788836284.869459:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+33:11533:x1875730518586752:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836284.869603:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+33:11533:x1875730518586752:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 145us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836284.869611:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:3.0:1788836284.874854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.874970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518586880 00000100:00100000:1.0:1788836284.874991:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518586880 00000100:00100000:1.0:1788836284.875060:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:1.0:1788836284.875070:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+33:11533:x1875730518586880:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.875090:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.875109:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875177:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875192:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875206:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836284.875240:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836284.875261:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875286:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b909f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b2 expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875303:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b2 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.875312:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:1.0:1788836284.875314:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836284.875318:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a600, rc 0) 00000100:00100000:1.0:1788836284.875401:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+34:11533:x1875730518586880:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 331us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.875413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1788836284.897320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.898667:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587008 00000100:00100000:1.0:1788836284.898678:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587008 00000100:00100000:1.0:1788836284.898746:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788836284.898768:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518587008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.898786:0:12003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.898809:0:12003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9b9 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836284.898836:0:12003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f79bb, blocks: 0x1 00010000:00010000:1.0:1788836284.898856:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788836284.898861:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836284.898870:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 8 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.898887:0:12003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 8 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.898901:0:12003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ba00, rc 0) 00000100:00100000:1.0:1788836284.898956:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518587008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 200us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.898963:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788836284.907320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.910063:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587264 00000100:00100000:2.0:1788836284.910077:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587264 00000100:00100000:1.0:1788836284.912002:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:1.0:1788836284.912015:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+34:11533:x1875730518587264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836284.912220:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+34:11533:x1875730518587264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 207us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.912228:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:3.0:1788836284.917935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836284.918029:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587392 00000100:00100000:1.0:1788836284.918039:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587392 00000100:00100000:1.0:1788836284.918109:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788836284.918121:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:11533:x1875730518587392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836284.918139:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836284.918157:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9c0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.918189:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.918199:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836284.918203:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836284.918209:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.918246:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.918262:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836284.918278:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45d7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538503424:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836284.918412:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836284.922004:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45d7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538503424:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836284.922058:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836284.922081:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978be00, rc 0) 00000100:00100000:1.0:1788836284.922144:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:11533:x1875730518587392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4026us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836284.922153:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788836284.924635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836284.924962:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587520 00000100:00100000:3.0:1788836284.924971:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587520 00010000:00010000:3.0:1788836284.925010:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.925059:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788836284.925070:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+9:2353:x1875730518587520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836284.925084:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836284.925106:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.925137:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.925161:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b909f54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b9 expref: 9 pid: 12003 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.925176:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836284.925180:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836284.925188:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.925199:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836284.925232:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836284.925245:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5816:1875730538503552:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788836284.925321:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836284.928881:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5816:1875730538503552:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788836284.928907:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836284.928963:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518587520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3895us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836284.928974:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788836284.940155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836284.940260:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587648 00000100:00100000:0.0:1788836284.940271:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587648 00002000:00100000:0.0:1788836284.940321:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bd0412ab100 x1875730518587648/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:450/0 lens 504/0 e 0 to 0 dl 1788836295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836284.940332:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0412ab100 with x1875730518587648 ext(0->8) 00002000:00010000:0.0:1788836284.940337:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd0412ab100 00000100:00100000:0.0:1788836284.940391:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836284.940401:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518587648:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788836284.940874:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:2354:x1875730518587648:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 473us (727us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788836284.940884:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00002000:00100000:0.0:1788836284.940892:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bd0412ab100 x1875730518587648/t4294967314(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:450/0 lens 504/448 e 0 to 0 dl 1788836295 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788836284.940901:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd0412ab100 with x1875730518587648 ext(0->8) 00002000:00010000:0.0:1788836284.940905:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd0412ab100 00000100:00100000:3.0:1788836284.943835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836284.944039:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587776 00000100:00100000:2.0:1788836284.944058:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587776 00000100:00100000:2.0:1788836284.944116:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:2.0:1788836284.944126:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+34:11533:x1875730518587776:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788836285.027184:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788836285.027321:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788836285.027490:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788836285.027651:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788836285.027664:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788836285.027954:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538503680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836285.028028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836285.028203:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538503680 00000100:00100000:2.0:1788836285.028211:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538503680 00000100:00100000:2.0:1788836285.028271:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836285.028279:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538503680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788836285.028474:0:12003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788836285.028477:0:12003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788836283 00002000:00010000:2.0:1788836285.028485:0:12003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788836285.028487:0:12003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788836283 -> 1788836283 00002000:00010000:2.0:1788836285.028489:0:12003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788836285.028543:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538503680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (514us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788836285.028551:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788836285.028667:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788836285.028703:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07a35ad80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788836285.028710:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538503680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788836285.029217:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:11533:x1875730518587776:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 85088us (85389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836285.029226:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:0.0:1788836285.032610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.032681:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518587904 00000100:00100000:3.0:1788836285.032691:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518587904 00000100:00100000:3.0:1788836285.032791:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788836285.032801:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+10:2355:x1875730518587904:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1788836285.032920:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788836285.136558:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788836285.136575:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788836285.156136:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2355:x1875730518587904:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 123327us (123525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836285.156148:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788836285.175639:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.178150:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588160 00000100:00100000:3.0:1788836285.178163:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588160 00000100:00100000:3.0:1788836285.178246:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:3.0:1788836285.178256:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+18:11533:x1875730518588160:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836285.178318:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836285.178360:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a600/0xcb5b7bc40b909f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9b2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.178379:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:3.0:1788836285.178383:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836285.178412:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.178424:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.178449:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836285.178917:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001033826a reply state 0000000075d2b615 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836285.179001:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836285.179452:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:11533:x1875730518588160:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1194us (3818us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788836285.179460:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00080000:0.0:1788836285.180191:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836285.194207:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194225:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194233:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194238:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836285.194244:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194251:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194268:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:0.0:1788836285.194271:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836285.194276:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.194281:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909f62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.201534:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836285.208365:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836285.208524:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588288 00000100:00100000:2.0:1788836285.208535:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588288 00000100:00100000:2.0:1788836285.208594:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788836285.208603:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518588288:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788836285.208857:0:12003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788836285.208861:0:12003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788836283 -> 1788836282 00002000:00010000:2.0:1788836285.208864:0:12003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788836280 00002000:00010000:2.0:1788836285.208866:0:12003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788836283 -> 1788836282 00002000:00010000:2.0:1788836285.208867:0:12003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788836285.208923:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518588288:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 320us (579us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788836285.208930:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788836285.222601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836285.222678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588544 00000100:00100000:2.0:1788836285.222690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588544 00000100:00100000:2.0:1788836285.222739:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:2.0:1788836285.222749:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+18:11533:x1875730518588544:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788836285.222822:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.222839:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.222863:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.222894:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.222907:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 18 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.222920:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538503808:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836285.223009:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0650783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836285.229498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836285.230229:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538503808:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836285.230259:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836285.230380:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588672 00000100:00100000:0.0:1788836285.230387:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588672 00010000:00010000:0.0:1788836285.230425:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 19 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836285.230483:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1788836285.230493:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+19:2354:x1875730518588672:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836285.230508:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836285.230515:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 19 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230527:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 19 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230550:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b600/0xcb5b7bc40b909f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9a4 expref: 19 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230564:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:0.0:1788836285.230569:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230578:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230586:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.230612:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836285.230659:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+18:2354:x1875730518588672:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 166us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836285.230666:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00010000:00010000:3.0:1788836285.231387:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231398:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231427:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231434:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231440:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231448:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836285.231452:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231468:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231480:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:3.0:1788836285.231483:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788836285.231487:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.231493:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b909f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836285.231553:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+17:11533:x1875730518588544:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 8805us (8960us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788836285.231562:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1788836285.248428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836285.250244:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588800 00000100:00100000:1.0:1788836285.250261:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588800 00000100:00100000:1.0:1788836285.250315:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788836285.250326:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518588800:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788836285.250394:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836285.250413:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836285.250441:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836285.250445:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836285.250449:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836285.250482:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836285.250495:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 8 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836285.250509:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538503936:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836285.250596:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd041254900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836285.253721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836285.253833:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538503936:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836285.253861:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.261239:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518588928 00000100:00100000:2.0:1788836285.261252:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518588928 00010000:00010000:2.0:1788836285.261296:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.261357:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788836285.261369:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518588928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836285.261384:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836285.261406:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.261441:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.261466:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b62c42c/0xcb5b7bc40b909f5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c0 expref: 9 pid: 6680 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.261481:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836285.261486:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836285.261491:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.261500:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.261530:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836285.261591:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518588928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 224us (7879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.261598:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00010000:00010000:0.0:1788836285.261668:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261684:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261707:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261714:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261721:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261727:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836285.261731:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261738:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261761:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.261768:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000887e577/0xcb5b7bc40b909f70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836285.261823:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518588800:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 11499us (13408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836285.261831:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788836285.267765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538504064:0@lo:400:kworker.0 00000100:00100000:0.0:1788836285.267832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836285.267879:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538504576:0@lo:400:kworker.0 00000100:00100000:0.0:1788836285.267903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836285.267925:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836285.267931:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538504448:0@lo:400:kworker.0 00000100:00100000:0.0:1788836285.267955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836285.268009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504064 00000100:00100000:2.0:1788836285.268016:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504064 00000100:00100000:2.0:1788836285.268068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788836285.268076:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538504064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836285.268135:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538504064:12345-0@lo:400:kworker.0 Request processed in 59us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.268141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788836285.268180:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504448 00000100:00100000:2.0:1788836285.268183:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504448 00000100:00100000:2.0:1788836285.268213:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788836285.268218:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875730538504448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836285.268246:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875730538504448:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.268251:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788836285.268281:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538504448:0@lo:400:kworker.0 00000100:00100000:2.0:1788836285.268288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538504064:0@lo:400:kworker.0 00000100:00080000:2.0:1788836285.268310:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836285.268819:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538504192:0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.268854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836285.268876:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836285.268881:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538504320:0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.268900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836285.268925:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504576 00000100:00100000:3.0:1788836285.268928:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504576 00000100:00100000:3.0:1788836285.268974:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504192 00000100:00100000:3.0:1788836285.268977:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504192 00000100:00100000:3.0:1788836285.268989:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504320 00000100:00100000:3.0:1788836285.268991:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504320 00000100:00100000:3.0:1788836285.269003:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788836285.269009:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538504576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.269064:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875730538504576:12345-0@lo:400:kworker.0 Request processed in 55us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836285.269071:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788836285.269083:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788836285.269098:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538504192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.269127:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538504192:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836285.269132:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788836285.269142:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788836285.269147:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538504320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.269170:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538504320:12345-0@lo:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836285.269175:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788836285.269208:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538504320:0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.269217:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538504192:0@lo:400:kworker.0 00000100:00080000:3.0:1788836285.269235:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836285.269616:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1875730538504576:0@lo:400:kworker.0 00000100:00100000:3.0:1788836285.269788:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538504704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836285.269818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836285.269886:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504704 00000100:00100000:2.0:1788836285.269891:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504704 00000100:00100000:2.0:1788836285.269930:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836285.269938:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538504704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836285.269966:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836285.270011:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538504704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.270018:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836285.270503:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538504704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836285.276927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.277001:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518589184 00000100:00100000:3.0:1788836285.277012:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518589184 00000100:00100000:3.0:1788836285.277079:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:3.0:1788836285.277098:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+17:11533:x1875730518589184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788836285.277173:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277208:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277220:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277453:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277465:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277474:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277508:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.277522:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 18 pid: 5829 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836285.277536:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538504832:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836285.277609:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bcec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836285.285758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.285847:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538504832:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836285.285886:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836285.287246:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518589312 00000100:00100000:0.0:1788836285.287258:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518589312 00010000:00010000:0.0:1788836285.287299:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 19 pid: 5829 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836285.287333:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1788836285.287370:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:2353:x1875730518589312:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836285.287385:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836285.287392:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 19 pid: 5829 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287403:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 19 pid: 5829 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287440:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a000/0xcb5b7bc40b909f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ab expref: 19 pid: 5829 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287454:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:0.0:1788836285.287459:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287467:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287474:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836285.287497:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836285.287559:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+18:2353:x1875730518589312:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 217us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836285.287567:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00010000:00010000:3.0:1788836285.287640:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.287655:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836285.287844:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788836285.288005:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788836285.288055:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788836285.288148:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538504960:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788836285.288204:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836285.288240:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836285.288667:0:12002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538504960 00000100:00100000:0.0:1788836285.288674:0:12002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538504960 00000100:00100000:0.0:1788836285.288747:0:12002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836285.288764:0:12002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538504960:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788836285.288838:0:12002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538504960:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836285.288846:0:12002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836285.289255:0:8192:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788836285.289262:0:8192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07a35ad80, transno 4294967315 00000100:00100000:3.0:1788836285.289279:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538504960:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788836285.289781:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788836285.289846:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538505088:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788836285.289895:0:8192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836285.297157:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836285.303827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538505088 00000100:00100000:1.0:1788836285.303842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538505088 00000100:00100000:1.0:1788836285.303906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836285.303915:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8192:x1875730538505088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788836285.304632:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8192:x1875730538505088:12345-0@lo:1000:mdt00_003.0 Request processed in 716us (14735us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788836285.304657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836285.304836:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0412a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8192:1875730538505088:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788836285.304877:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304887:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304895:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304901:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836285.304907:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304923:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304940:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd07a955c00) 00010000:00010000:3.0:1788836285.304943:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836285.304949:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304955:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909f7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304982:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304988:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304994:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.304998:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836285.305000:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305005:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305013:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:3.0:1788836285.305015:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836285.305017:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305032:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b909eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305053:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305067:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.305075:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.309310:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.309336:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 21 pid: 5830 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836285.309368:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538505216:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836285.309578:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836285.314618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836285.314683:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518589440 00000100:00100000:2.0:1788836285.314692:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518589440 00010000:00010000:2.0:1788836285.314731:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 22 pid: 5830 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.314776:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1788836285.314785:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:2353:x1875730518589440:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836285.314812:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836285.314819:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 22 pid: 5830 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.314832:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 22 pid: 5830 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.314854:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836285.314868:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.314879:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.314885:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.314904:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836285.314954:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:2353:x1875730518589440:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.314961:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:2.0:1788836285.315006:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b909ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a98f expref: 21 pid: 5830 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.315020:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538505216:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836285.315039:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315059:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315070:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315081:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315207:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315216:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315221:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836285.315225:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315242:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315251:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836285.315255:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836285.315259:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315265:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909f85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315275:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315281:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315292:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315298:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836285.315301:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315307:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315314:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836285.315316:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836285.315319:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.315324:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909f77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836285.315601:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836285.315606:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788836285.317737:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+20:11533:x1875730518589184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 40638us (40810us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788836285.317762:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000020:00080000:3.0:1788836285.317770:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788836285.318831:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788836285.318845:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836285.325742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.325936:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518589696 00000100:00100000:3.0:1788836285.325947:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518589696 00000100:00100000:3.0:1788836285.326007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788836285.326019:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+20:11533:x1875730518589696:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788836285.326721:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788836285.326831:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788836285.326882:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326899:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326910:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326919:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326926:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326932:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.326951:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788836285.327043:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:11533:x1875730518589696:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1309us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788836285.327052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000020:00080000:3.0:1788836285.327057:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836285.327107:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836285.327114:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.327122:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836285.327126:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.327142:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.327154:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836285.327157:0:6696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836285.327161:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.327167:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.327183:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836285.327185:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836285.327187:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836285.723772:0:12446:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836285.723781:0:12446:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836285.723818:0:12446:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788836285.723823:0:12446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788836285.780421:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538505344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836285.780507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836285.780888:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538505344 00000100:00100000:2.0:1788836285.780897:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538505344 00000100:00100000:2.0:1788836285.780954:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836285.780963:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538505344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836285.780991:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788836285.781055:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875730538505344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.781072:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836285.781121:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538505344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836285.917236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836285.917317:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518589952 00000100:00100000:3.0:1788836285.917331:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518589952 00000100:00100000:3.0:1788836285.917588:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1788836285.917599:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:11544:x1875730518589952:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836285.917630:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836285.917656:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9c7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.917782:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.917814:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.917830:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836285.917843:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788836285.918005:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c7 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.918023:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c7 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836285.918033:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836285.918036:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836285.918101:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d200, rc 0) 00000100:00100000:3.0:1788836285.918181:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+24:11544:x1875730518589952:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 584us (960us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788836285.918189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1788836285.924620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836285.924816:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518590080 00000100:00100000:2.0:1788836285.924831:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518590080 00000100:00100000:2.0:1788836285.924908:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1788836285.924921:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+24:11544:x1875730518590080:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788836285.925023:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925116:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925133:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925153:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925161:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925168:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925801:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925814:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925835:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836285.925895:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925913:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925920:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925928:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925935:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836285.925940:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925948:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836285.925968:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836285.925974:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925980:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b909fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.925993:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926007:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926014:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926019:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836285.926022:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926029:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926185:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd04940be00) 00010000:00010000:2.0:1788836285.926189:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836285.926193:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926200:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b909faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926218:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926226:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926231:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926236:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836285.926246:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926253:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926262:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836285.926265:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836285.926267:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836285.926274:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b909fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836285.929894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+24:11544:x1875730518590080:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 4959us (5268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836285.929911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1788836286.005622:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.010595:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518590336 00000100:00100000:3.0:1788836286.010617:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518590336 00000100:00100000:3.0:1788836286.010709:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:3.0:1788836286.010722:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+24:11547:x1875730518590336:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836286.010759:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836286.010787:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010925:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010944:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010957:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010978:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010985:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.010994:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.011803:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.011817:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.011827:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836286.011840:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788836286.012108:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012118:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012135:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012142:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.012148:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012157:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012172:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836286.012176:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.012181:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012188:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b909fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012204:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012211:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012218:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012224:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.012226:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012243:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012253:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836286.012255:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.012259:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b909fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012322:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b909fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012951:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.012968:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.012970:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836286.012974:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c600, rc 0) 00000100:00100000:3.0:1788836286.013693:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+26:11547:x1875730518590336:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2966us (8078us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788836286.013706:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:2.0:1788836286.034824:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.039637:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518590464 00000100:00100000:3.0:1788836286.039659:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518590464 00000100:00100000:3.0:1788836286.039762:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:3.0:1788836286.039775:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+26:11547:x1875730518590464:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788836286.039889:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.039919:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.039933:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.039966:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040184:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040193:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040199:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.040205:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040213:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040228:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.040231:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836286.040237:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.040244:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836286.040402:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+26:11547:x1875730518590464:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 628us (5592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836286.040411:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:2.0:1788836286.061792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.061943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518590720 00000100:00100000:3.0:1788836286.061956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518590720 00000100:00100000:3.0:1788836286.062158:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788836286.062170:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:11547:x1875730518590720:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836286.063195:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:11547:x1875730518590720:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 1018us (1486us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788836286.063209:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788836286.145036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.145102:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518590976 00000100:00100000:0.0:1788836286.145116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518590976 00000100:00100000:0.0:1788836286.145186:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788836286.145199:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:11080:x1875730518590976:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836286.145234:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836286.145263:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c800/0xcb5b7bc40b909fe7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9d5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.145415:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.145433:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.145443:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.145485:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.145500:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 28 pid: 5829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836286.145516:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538505472:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836286.145627:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788836286.162311:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd043071500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538505472:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788836286.162380:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.162886:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836286.163017:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591104 00000100:00100000:1.0:1788836286.163026:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591104 00010000:00010000:1.0:1788836286.163086:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 29 pid: 5829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836286.163138:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1788836286.163151:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:2353:x1875730518591104:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836286.163171:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836286.163179:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 29 pid: 5829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163194:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 29 pid: 5829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163221:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b909fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ce expref: 29 pid: 5829 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163238:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836286.163244:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163268:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163276:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163302:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836286.163399:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+28:2353:x1875730518591104:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 250us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836286.163407:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00010000:00010000:1.0:1788836286.163436:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163444:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836286.163468:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788836286.163683:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c800/0xcb5b7bc40b909fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163701:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.163709:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836286.163712:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788836286.163714:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d400, rc 0) 00000100:00100000:1.0:1788836286.163753:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:11080:x1875730518590976:12345-192.168.203.52@tcp:101:bash.0 Request processed in 18548us (18726us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788836286.163772:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788836286.166816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.166891:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591360 00000100:00100000:3.0:1788836286.166906:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591360 00000100:00100000:3.0:1788836286.166970:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:3.0:1788836286.166983:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+28:11080:x1875730518591360:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788836286.167392:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.167413:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.167428:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836286.167488:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788836286.167528:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070558297 reply state 00000000ebdba07d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836286.167538:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788836286.167593:0:8192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788836286.167719:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+32:11080:x1875730518591360:12345-192.168.203.52@tcp:36:bash.0 Request processed in 736us (914us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788836286.167764:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000020:00080000:3.0:1788836286.167771:0:8192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788836286.171925:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.171951:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.171960:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.171966:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.171973:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.171981:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.172004:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.172008:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.172013:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.172020:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b909ffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836286.175213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.175646:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591488 00000100:00100000:3.0:1788836286.175661:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591488 00000100:00100000:3.0:1788836286.175736:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1788836286.175757:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+31:11080:x1875730518591488:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836286.175797:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836286.175826:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9dc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.175909:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9dc expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.175929:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9dc expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.175953:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.175957:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836286.175961:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d400, rc 0) 00000100:00100000:3.0:1788836286.176151:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+32:11080:x1875730518591488:12345-192.168.203.52@tcp:101:bash.0 Request processed in 405us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836286.176159:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:2.0:1788836286.180732:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.180828:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591616 00000100:00100000:0.0:1788836286.180843:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591616 00000100:00100000:0.0:1788836286.180917:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788836286.180930:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:11080:x1875730518591616:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836286.180954:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836286.180981:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9e3 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836286.181015:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f79ba, atime: 0x6a9f79b8, ctime: 0x6a9f79ba, blocks: 0xb 00010000:00010000:0.0:1788836286.181052:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788836286.181057:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836286.181067:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.181089:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.181105:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217cc00, rc 0) 00000100:00100000:0.0:1788836286.181185:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:11080:x1875730518591616:12345-192.168.203.52@tcp:101:bash.0 Request processed in 257us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836286.181192:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788836286.187465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.187611:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591744 00000100:00100000:3.0:1788836286.187627:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591744 00002000:00010000:3.0:1788836286.187684:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788836286.187691:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd043071500 with x1875730518591744 ext(0->18446744073709551615) 00002000:00010000:3.0:1788836286.187706:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd043071500. 00000100:00100000:3.0:1788836286.187756:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788836286.187769:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+8:2356:x1875730518591744:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:3.0:1788836286.188217:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788836286.188221:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788836282 -> 1788836284 00002000:00010000:3.0:1788836286.188224:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788836280 -> 1788836280 00002000:00010000:3.0:1788836286.188246:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788836282 -> 1788836284 00002000:00010000:3.0:1788836286.188248:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788836286.188374:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2356:x1875730518591744:12345-192.168.203.52@tcp:10:bash.0 Request processed in 574us (892us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788836286.188383:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00010000:3.0:1788836286.188388:0:6687:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788836286.188391:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd043071500 with x1875730518591744 ext(0->18446744073709551615) 00002000:00010000:3.0:1788836286.188397:0:6687:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd043071500. 00010000:00010000:3.0:1788836286.224788:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836286.327092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.327261:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518591872 00000100:00100000:3.0:1788836286.327276:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518591872 00000100:00100000:3.0:1788836286.327421:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:3.0:1788836286.327435:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+32:11561:x1875730518591872:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788836286.327752:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.327777:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.327792:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.327810:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.327818:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.327825:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329655:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329679:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329693:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836286.329766:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329782:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329789:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329798:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329805:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.329810:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329818:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.329832:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836286.329836:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.329841:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.330997:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.331025:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.331033:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332828:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332836:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.332843:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332854:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332887:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836286.332891:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.332896:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332904:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332937:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332945:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332973:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332979:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.332982:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332989:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.332998:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.333001:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.333004:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.333010:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a01f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836286.333160:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+32:11561:x1875730518591872:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 5721us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836286.333172:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:2.0:1788836286.410834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836286.413943:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518592128 00000100:00100000:1.0:1788836286.413971:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518592128 00000100:00100000:1.0:1788836286.414225:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788836286.414242:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+32:11564:x1875730518592128:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836286.414275:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836286.414304:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90a026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9ea expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414463:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414483:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414498:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414526:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414535:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414542:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414918:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414941:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.414949:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836286.414962:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788836286.415108:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415116:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415124:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415132:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836286.415138:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415149:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415167:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:1.0:1788836286.415171:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836286.415177:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415184:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a02d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415198:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415211:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415218:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415223:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836286.415227:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415233:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415241:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd07a955900) 00010000:00010000:1.0:1788836286.415244:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836286.415246:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415252:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415305:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978aa00/0xcb5b7bc40b90a026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ea expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415322:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ea expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.415329:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836286.415332:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836286.415415:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ac00, rc 0) 00000100:00100000:1.0:1788836286.415504:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+34:11564:x1875730518592128:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1266us (4685us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788836286.415513:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:0.0:1788836286.422137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836286.422209:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518592256 00000100:00100000:2.0:1788836286.422224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518592256 00000100:00100000:2.0:1788836286.422374:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788836286.422397:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+34:11564:x1875730518592256:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788836286.422525:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.422546:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.422555:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.422590:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.422601:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 34 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.422614:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a358700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538505600:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836286.422800:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836286.433673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836286.434007:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518592512 00000100:00100000:1.0:1788836286.434021:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518592512 00000100:00100000:1.0:1788836286.434102:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1788836286.434114:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+35:5589:x1875730518592512:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788836286.435326:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a358700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538505600:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836286.435376:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836286.435981:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+36:5589:x1875730518592512:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 1865us (2318us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788836286.436016:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788836286.439153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836286.439308:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518592640 00000100:00100000:1.0:1788836286.439321:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518592640 00010000:00010000:1.0:1788836286.439472:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 36 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836286.439636:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788836286.439649:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047941c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+36:2353:x1875730518592640:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836286.439673:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836286.439682:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 36 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.439807:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 36 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.439838:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d400/0xcb5b7bc40b909fee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9d5 expref: 36 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.439941:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836286.439949:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.439979:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.439988:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836286.440124:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836286.440234:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047941c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+35:2353:x1875730518592640:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 586us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836286.440243:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:2.0:1788836286.440336:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440373:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440415:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440431:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440439:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440446:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836286.440453:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440461:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440473:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:2.0:1788836286.440475:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836286.440480:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.440487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998200/0xcb5b7bc40b90a049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.440548:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+34:11564:x1875730518592256:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 18154us (18422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836286.440557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788836286.444333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.444491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518592896 00000100:00100000:0.0:1788836286.444515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518592896 00000100:00100000:0.0:1788836286.444590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788836286.444604:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+34:11564:x1875730518592896:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836286.445151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+35:11564:x1875730518592896:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 547us (828us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788836286.445159:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788836286.564483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.565458:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518593152 00000100:00100000:3.0:1788836286.565476:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518593152 00000100:00100000:3.0:1788836286.565567:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:3.0:1788836286.565580:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+35:11575:x1875730518593152:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788836286.565614:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836286.565641:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9f1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565778:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565797:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565811:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565828:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565836:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.565843:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566215:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566226:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566234:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836286.566248:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788836286.566453:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566462:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566478:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566484:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.566489:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566497:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566512:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836286.566515:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.566520:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566526:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566540:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566547:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566554:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566559:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.566562:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566577:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566586:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:3.0:1788836286.566588:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.566591:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566597:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a05e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566651:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f1 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566668:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f1 expref: 37 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.566676:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.566678:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836286.566680:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836286.566785:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+37:11575:x1875730518593152:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1207us (2316us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788836286.566795:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1788836286.578300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.578456:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518593408 00000100:00100000:0.0:1788836286.578470:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518593408 00000100:00100000:0.0:1788836286.578550:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788836286.578562:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+37:11575:x1875730518593408:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1788836286.578891:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+38:11575:x1875730518593408:12345-192.168.203.52@tcp:35:cat.0 Request processed in 331us (605us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788836286.578901:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1788836286.610806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.610999:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518593664 00000100:00100000:3.0:1788836286.611012:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518593664 00000100:00100000:3.0:1788836286.611093:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:3.0:1788836286.611104:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+38:11576:x1875730518593664:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788836286.611212:0:8192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788836286.611247:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f1 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611275:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ea expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611578:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9dc expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611591:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.611602:0:8192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836286.611630:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611647:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611659:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611675:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611682:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.611689:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.612448:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.612463:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.612472:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836286.615679:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788836286.615701:0:8192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339750357346ns, next at 340750352060ns, rc = 0 00010000:00010000:3.0:1788836286.615822:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.615845:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.616581:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.616602:0:8192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.616610:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.616617:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616801:0:8192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836286.616838:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616883:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616889:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616897:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836286.616902:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616911:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616928:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:2.0:1788836286.616931:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788836286.616937:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616942:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a081 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616969:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616976:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616982:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.616987:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836286.616998:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.617004:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.617013:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836286.617015:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836286.617019:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.617025:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a073 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836286.617047:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9dfbd4e reply state 00000000242f2910 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.617058:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836286.617431:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+37:11576:x1875730518593664:12345-192.168.203.52@tcp:36:rm.0 Request processed in 6322us (6635us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788836286.617442:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00010000:00010000:3.0:1788836286.617784:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836286.617794:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.617811:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836286.617816:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.617824:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.617838:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:3.0:1788836286.617841:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788836286.617845:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.617851:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a088 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.617885:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836286.617888:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836286.617890:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836286.637523:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637545:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637554:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637561:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836286.637587:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637597:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637618:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2200) 00010000:00010000:0.0:1788836286.637621:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836286.637627:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.637633:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a07a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.709970:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836286.714244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518593920 00000100:00100000:3.0:1788836286.714264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518593920 00000100:00100000:3.0:1788836286.714436:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:3.0:1788836286.714450:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+36:11582:x1875730518593920:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788836286.714485:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836286.714522:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a08f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9f8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714679:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714697:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714750:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714770:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714778:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.714786:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836286.715533:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788836286.715733:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715761:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715771:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715813:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715821:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715829:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715836:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.715849:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715859:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715875:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836286.715878:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.715884:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715891:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a096 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836286.715906:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001e23cfa reply state 000000004e8be7ea transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836286.715917:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836286.715955:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a08f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715972:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.715980:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836286.715983:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836286.715986:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0de00, rc 0) 00000100:00100000:3.0:1788836286.716099:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+39:11582:x1875730518593920:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1652us (6143us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788836286.716108:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00010000:00010000:3.0:1788836286.722016:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722048:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722058:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722065:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836286.722071:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722080:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722102:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2500) 00010000:00010000:3.0:1788836286.722105:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836286.722110:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.722117:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a09d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.725959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.726093:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594048 00000100:00100000:0.0:1788836286.726108:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594048 00000100:00100000:0.0:1788836286.726203:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788836286.726216:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518594048:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836286.726239:0:12003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836286.726265:0:12003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316a9ff expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836286.726300:0:12003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788836286.726326:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788836286.726331:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836286.726403:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 6 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.726428:0:12003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 6 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.726463:0:12003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d600, rc 0) 00000100:00100000:0.0:1788836286.726543:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518594048:12345-192.168.203.52@tcp:101:bash.0 Request processed in 330us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836286.726551:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00080000:3.0:1788836286.726990:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836286.730697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.730815:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594176 00000100:00100000:0.0:1788836286.730827:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594176 00000100:00100000:0.0:1788836286.730899:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788836286.730909:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+6:11582:x1875730518594176:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836286.730932:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836286.730968:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa06 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.731009:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 7 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.731020:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836286.731025:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836286.731031:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.731073:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 7 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.731089:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 7 pid: 12003 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836286.731125:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875730538505728:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836286.731264:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836286.735109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836286.735279:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594304 00000100:00100000:2.0:1788836286.735292:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594304 00010000:00010000:2.0:1788836286.735390:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 8 pid: 12003 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.735446:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:2.0:1788836286.735457:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518594304:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836286.735493:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836286.735591:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 8 pid: 12003 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.735609:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 8 pid: 12003 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.735643:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836286.735649:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836286.735659:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.735670:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836286.735913:0:8494:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836286.735934:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8494:1875730538505856:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788836286.736045:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427600 going to sleep for 11 seconds 00010000:00010000:3.0:1788836286.736303:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000401f633a/0xcb5b7bc40b90a0b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9ff expref: 8 pid: 12003 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836286.736321:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875730538505728:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836286.736404:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836286.736434:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217ca00, rc 0) 00000100:00100000:3.0:1788836286.736475:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:11582:x1875730518594176:12345-192.168.203.52@tcp:101:bash.0 Request processed in 5566us (5791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836286.736484:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788836286.739979:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8494:1875730538505856:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788836286.740018:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836286.740103:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+6:2354:x1875730518594304:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4647us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836286.740117:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788836286.744595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836286.744807:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594560 00000100:00100000:2.0:1788836286.744822:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594560 00000100:00100000:2.0:1788836286.744893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788836286.744912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+38:11582:x1875730518594560:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788836286.745517:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+39:11582:x1875730518594560:12345-192.168.203.52@tcp:35:bash.0 Request processed in 608us (935us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788836286.745546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788836286.975672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836286.975958:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594688 00000100:00100000:0.0:1788836286.975974:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594688 00000100:00100000:0.0:1788836286.976055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1788836286.976068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+39:11598:x1875730518594688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836286.976105:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836286.976133:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90a0c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa0d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976236:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976255:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976285:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836286.976407:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788836286.976413:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836286.976450:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976483:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217dc00/0xcb5b7bc40b90a0c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa0d expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976505:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa0d expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836286.976514:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836286.976517:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836286.976522:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d800, rc 0) 00000100:00100000:0.0:1788836286.976613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+40:11598:x1875730518594688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 548us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836286.977087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1788836287.006748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836287.007534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518594944 00000100:00100000:1.0:1788836287.007549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518594944 00000100:00100000:1.0:1788836287.007657:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788836287.007672:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+40:11598:x1875730518594944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836287.007700:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836287.007728:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a0ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa14 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.007867:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a0d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.007885:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.007898:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a0d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836287.007909:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788836287.008245:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a0ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa14 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.008289:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a0d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa14 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836287.008453:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788836287.009578:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:1.0:1788836287.009583:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836287.009588:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b400, rc 0) 00000100:00100000:1.0:1788836287.009713:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+42:11598:x1875730518594944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2041us (2982us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788836287.009724:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788836287.018256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836287.018319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.018399:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595328 00000100:00100000:3.0:1788836287.018413:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595328 00000100:00100000:3.0:1788836287.018488:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:3.0:1788836287.018509:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+42:11598:x1875730518595328:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836287.018542:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788836287.018549:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595072 00000100:00100000:2.0:1788836287.018554:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595072 00010000:00010000:3.0:1788836287.018570:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a0e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa1b expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.018601:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836287.018610:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+44:2354:x1875730518595072:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836287.018624:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836287.018649:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a0d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa14 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.018668:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:2.0:1788836287.018673:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836287.018732:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.018754:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+43:2354:x1875730518595072:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 146us (513us total) trans 0 rc 0/0 00010000:00010000:3.0:1788836287.018761:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.018761:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:3.0:1788836287.018773:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836287.018786:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788836287.018939:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a0e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa1b expref: 44 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.018969:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa1b expref: 43 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.018976:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:3.0:1788836287.018979:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788836287.018981:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836287.019021:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+43:11598:x1875730518595328:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 524us (700us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788836287.019028:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:1.0:1788836287.037853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.037958:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595456 00000100:00100000:0.0:1788836287.037970:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595456 00000100:00100000:0.0:1788836287.038048:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788836287.038059:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+6:2353:x1875730518595456:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:0.0:1788836287.038117:0:12003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.038142:0:12003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.038180:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788836287.038185:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836287.038190:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.038240:0:12003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.038255:0:12003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 6 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.038272:0:12003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12003:1875730538505984:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836287.038450:0:12003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836287.044237:0:12003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12003:1875730538505984:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836287.044281:0:12003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836287.045633:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.053732:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595584 00000100:00100000:3.0:1788836287.053765:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595584 00002000:00100000:3.0:1788836287.057102:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bcf45d7ce00 x1875730518595584/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:453/0 lens 504/0 e 0 to 0 dl 1788836298 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836287.057125:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bcf45d7ce00 with x1875730518595584 ext(0->8) 00010000:00010000:3.0:1788836287.057638:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 7 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.057664:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 7 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836287.057674:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bcf45d7ce00 00000100:00100000:3.0:1788836287.057807:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788836287.057831:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518595584:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:3.0:1788836287.058585:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+9:2353:x1875730518595584:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 762us (12966us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788836287.058603:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:3.0:1788836287.058616:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bcf45d7ce00 x1875730518595584/t4294967308(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:453/0 lens 504/448 e 0 to 0 dl 1788836298 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836287.058628:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bcf45d7ce00 with x1875730518595584 ext(0->8) 00010000:00010000:3.0:1788836287.058638:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.058654:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836287.058662:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9bcf45d7ce00 00000100:00100000:2.0:1788836287.062676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836287.062818:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595712 00000100:00100000:1.0:1788836287.062831:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595712 00010000:00010000:1.0:1788836287.062883:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836287.063147:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1788836287.063159:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518595712:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836287.063180:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788836287.063206:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788836287.063210:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788836285 00002000:00010000:1.0:1788836287.063213:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788836285 00002000:00010000:1.0:1788836287.063215:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788836285 00010000:00010000:1.0:1788836287.063240:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.063257:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.063668:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a0b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa06 expref: 9 pid: 6683 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.063691:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836287.063697:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836287.063704:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.063716:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836287.063768:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836287.063852:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518595712:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 695us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836287.063860:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:0.0:1788836287.065772:0:12003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065796:0:12003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065842:0:12003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065872:0:12003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065882:0:12003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065890:0:12003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836287.065895:0:12003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065905:0:12003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065943:0:12003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.065952:0:12003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a0f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.066065:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518595456:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 28002us (28219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.066076:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788836287.080595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.080759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518595968 00000100:00100000:3.0:1788836287.080772:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518595968 00000100:00100000:3.0:1788836287.080840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788836287.080851:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+43:11598:x1875730518595968:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788836287.080939:0:5832:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa1b expref: 43 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836287.081322:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788836287.081412:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788836287.093650:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788836287.093815:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.093843:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.093855:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.093923:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 47 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.093968:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 47 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.093989:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875730538506112:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836287.095789:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836287.108520:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1875730538506112:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836287.108565:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.111836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.112637:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596096 00000100:00100000:2.0:1788836287.112652:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596096 00010000:00010000:2.0:1788836287.112709:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 48 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.112811:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1788836287.112823:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+48:2354:x1875730518596096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836287.112845:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836287.112854:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 48 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.112882:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 48 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.112912:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a0a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9f8 expref: 48 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.112964:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:2.0:1788836287.112970:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.112981:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.112989:0:8494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.113027:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836287.113110:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+47:2354:x1875730518596096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 289us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836287.113118:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00010000:00010000:3.0:1788836287.113337:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.113365:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836287.113536:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788836287.113820:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788836287.113961:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538506240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788836287.114033:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836287.114071:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836287.114455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538506240 00000100:00100000:1.0:1788836287.114464:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538506240 00000100:00100000:1.0:1788836287.114542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836287.114554:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875730538506240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788836287.114646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875730538506240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836287.114666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836287.114720:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538506240:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788836287.115422:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788836287.116165:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788836287.116278:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45d7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538506368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788836287.117015:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836287.117056:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836287.117597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538506368 00000100:00100000:3.0:1788836287.117608:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538506368 00000100:00100000:3.0:1788836287.117686:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836287.117697:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875730538506368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788836287.117993:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5832:x1875730538506368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 297us (978us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788836287.118002:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836287.118325:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45d7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1875730538506368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788836287.118467:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788836287.118678:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118692:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118701:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118708:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836287.118713:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118722:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118750:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:0.0:1788836287.118754:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788836287.118759:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.118767:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a0ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788836287.119000:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788836287.119131:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788836287.119606:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340254262507ns, next at 341254258443ns, rc = 0 00000001:00080000:0.0:1788836287.119616:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788836287.119668:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd0452e2000) 00010000:00010000:0.0:1788836287.119673:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788836287.119696:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a0ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa1b expref: 51 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.119849:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d28450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+50:11598:x1875730518595968:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 38998us (39265us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788836287.119860:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000020:00080000:0.0:1788836287.119866:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788836287.123288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.123570:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596224 00000100:00100000:3.0:1788836287.123580:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596224 00000100:00100000:2.0:1788836287.123803:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:2.0:1788836287.123819:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+50:11598:x1875730518596224:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836287.123854:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836287.123885:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90a106 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa22 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.123967:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90a106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa22 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.123988:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90a106 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa22 expref: 51 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.124010:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.124042:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836287.124047:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998000, rc 0) 00000100:00100000:2.0:1788836287.124142:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+51:11598:x1875730518596224:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 316us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836287.124150:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:1.0:1788836287.130999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.131154:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596480 00000100:00100000:0.0:1788836287.131164:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596480 00000100:00100000:0.0:1788836287.131268:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788836287.131279:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+51:11598:x1875730518596480:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788836287.131814:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+52:11598:x1875730518596480:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 534us (821us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788836287.131822:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788836287.203073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.203125:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596608 00000100:00100000:3.0:1788836287.203136:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596608 00000100:00100000:3.0:1788836287.203189:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1788836287.203197:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+52:11608:x1875730518596608:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788836287.203270:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203285:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203298:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203309:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203328:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203332:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203437:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203442:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203446:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836287.203480:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203489:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203493:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203498:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203511:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836287.203514:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203520:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203534:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836287.203536:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836287.203539:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203543:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a10d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203553:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203558:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203564:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203569:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ca00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836287.203571:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203577:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203584:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2500) 00010000:00010000:3.0:1788836287.203586:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836287.203590:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203596:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203620:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203626:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203630:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203635:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836287.203637:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203643:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203650:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836287.203652:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836287.203655:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.203661:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a11b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836287.203730:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+52:11608:x1875730518596608:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 532us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836287.203751:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00010000:00010000:3.0:1788836287.248652:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836287.249928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.250298:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596864 00000100:00100000:2.0:1788836287.250313:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596864 00000100:00100000:2.0:1788836287.250653:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788836287.250667:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+52:11611:x1875730518596864:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836287.250700:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836287.250729:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a122 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa29 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252328:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252375:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252392:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252417:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252425:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252432:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252614:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252624:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252632:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836287.252644:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788836287.252790:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252798:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252806:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252812:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836287.252817:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252826:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252842:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836287.252845:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836287.252852:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252870:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252890:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252897:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252904:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252909:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836287.252913:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252920:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252928:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd04940be00) 00010000:00010000:2.0:1788836287.252931:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836287.252934:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.252940:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.253000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a122 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa29 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.253462:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa29 expref: 54 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.253482:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.253485:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836287.253488:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999e00, rc 0) 00000100:00100000:2.0:1788836287.253664:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+54:11611:x1875730518596864:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2999us (3749us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788836287.253675:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:1.0:1788836287.264101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.264232:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518596992 00000100:00100000:0.0:1788836287.264245:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518596992 00000100:00100000:0.0:1788836287.264326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1788836287.264338:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+54:11611:x1875730518596992:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788836287.264488:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264510:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264525:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264585:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264592:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264599:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264606:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836287.264610:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264618:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264644:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836287.264647:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836287.264653:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.264659:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.264771:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+54:11611:x1875730518596992:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 434us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.264779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1788836287.275500:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836287.275602:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518597248 00000100:00100000:1.0:1788836287.275615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518597248 00000100:00100000:1.0:1788836287.275700:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788836287.275712:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+54:11611:x1875730518597248:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836287.276037:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+55:11611:x1875730518597248:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 325us (550us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788836287.276046:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788836287.406266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.406384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518597504 00000100:00100000:2.0:1788836287.406393:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518597504 00000100:00100000:2.0:1788836287.406503:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1788836287.406515:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+55:11621:x1875730518597504:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788836287.406541:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836287.406544:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788836287.406570:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a0c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa0d expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406588:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836287.406655:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836287.406670:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a14c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa30 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406771:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406783:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406792:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836287.406815:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788836287.406934:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a14c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa30 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406950:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa30 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.406957:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.406959:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836287.406962:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998a00, rc 0) 00000100:00100000:2.0:1788836287.407024:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+56:11621:x1875730518597504:12345-192.168.203.52@tcp:101:bash.0 Request processed in 512us (768us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788836287.407031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:3.0:1788836287.412176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.412295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518597760 00000100:00100000:0.0:1788836287.412305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518597760 00000100:00100000:0.0:1788836287.412388:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:0.0:1788836287.412397:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+56:11621:x1875730518597760:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1788836287.412459:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788836287.412486:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998a00/0xcb5b7bc40b90a153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa30 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.412522:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa29 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.412532:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836287.412537:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836287.412747:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.412760:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.412769:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788836287.412814:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788836287.412834:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012d9c930 reply state 00000000d17f5bde transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.412843:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836287.412947:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+57:11621:x1875730518597760:12345-192.168.203.52@tcp:36:bash.0 Request processed in 550us (780us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788836287.412954:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000020:00080000:0.0:1788836287.412960:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788836287.416266:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416284:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416292:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416298:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836287.416303:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416310:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416328:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836287.416331:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836287.416335:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.416365:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d800/0xcb5b7bc40b90a161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836287.416768:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.417235:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518597888 00000100:00100000:0.0:1788836287.417254:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518597888 00000100:00100000:0.0:1788836287.417394:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:0.0:1788836287.417405:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+56:11621:x1875730518597888:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836287.417429:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836287.417450:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa37 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417557:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417570:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417580:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836287.417609:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788836287.417613:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836287.417632:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417662:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 58 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417679:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 57 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.417686:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836287.417689:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836287.417692:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c000, rc 0) 00000100:00100000:0.0:1788836287.417757:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+57:11621:x1875730518597888:12345-192.168.203.52@tcp:101:bash.0 Request processed in 355us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.417764:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:0.0:1788836287.421170:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.421327:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598144 00000100:00100000:2.0:1788836287.421337:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598144 00000100:00100000:2.0:1788836287.421522:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788836287.421532:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+57:11621:x1875730518598144:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788836287.421799:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+58:11621:x1875730518598144:12345-192.168.203.52@tcp:35:bash.0 Request processed in 268us (638us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788836287.421806:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788836287.453458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.453570:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598272 00000100:00100000:0.0:1788836287.453580:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598272 00000100:00100000:0.0:1788836287.453639:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:0.0:1788836287.453649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+58:11627:x1875730518598272:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836287.453674:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836287.453696:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa3e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453779:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453793:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453804:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836287.453836:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788836287.453841:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836287.453869:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453894:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa3e expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453913:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa3e expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.453934:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836287.453938:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836287.453941:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217de00, rc 0) 00000100:00100000:0.0:1788836287.454019:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518598272:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 371us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.454027:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1788836287.458403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.458614:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598400 00000100:00100000:2.0:1788836287.458622:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598400 00000100:00100000:2.0:1788836287.458684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:2.0:1788836287.458696:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518598400:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836287.458715:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836287.458758:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa45 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458820:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458834:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458846:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458860:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458874:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458953:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458961:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.458967:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836287.458999:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788836287.459003:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836287.459020:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459036:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459045:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459051:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459059:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459065:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836287.459069:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459077:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459088:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:2.0:1788836287.459091:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836287.459095:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459102:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a18b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459113:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459119:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459129:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459134:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836287.459137:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459143:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459150:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd04940be00) 00010000:00010000:2.0:1788836287.459152:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836287.459155:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459161:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999600/0xcb5b7bc40b90a192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459185:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999800/0xcb5b7bc40b90a184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa45 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459196:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa45 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.459203:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.459205:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836287.459208:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998c00, rc 0) 00000100:00100000:2.0:1788836287.459273:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+60:11627:x1875730518598400:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 580us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836287.459289:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1788836287.462572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836287.462661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.462718:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598528 00000100:00100000:2.0:1788836287.462728:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598528 00000100:00100000:3.0:1788836287.462784:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598784 00000100:00100000:3.0:1788836287.462790:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598784 00000100:00100000:2.0:1788836287.462850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788836287.462873:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:2353:x1875730518598528:12345-192.168.203.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788836287.462883:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:3.0:1788836287.462894:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+61:11627:x1875730518598784:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836287.462909:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836287.462914:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836287.462934:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa4c expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.462935:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998c00/0xcb5b7bc40b90a199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa45 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.462963:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.462983:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836287.463070:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.463084:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.463094:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836287.463115:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:2353:x1875730518598528:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 255us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836287.463125:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:3.0:1788836287.463130:0:8192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.463145:0:8192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 60 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836287.463166:0:8192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538506496:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836287.463229:0:8192:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06901d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836287.465873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836287.466002:0:8192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8192:1875730538506496:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836287.466038:0:8192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.466109:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518598912 00000100:00100000:0.0:1788836287.466116:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518598912 00010000:00010000:0.0:1788836287.466153:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836287.466260:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:0.0:1788836287.466271:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+61:2354:x1875730518598912:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836287.466287:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836287.466294:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466306:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466329:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa37 expref: 61 pid: 5829 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466385:0:6697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836287.466391:0:6697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466411:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466420:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.466446:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836287.466505:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+60:2354:x1875730518598912:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 236us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.466513:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:3.0:1788836287.466577:0:8192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.466586:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836287.466604:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788836287.466773:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 61 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.466791:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 60 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.466799:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836287.466801:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836287.466804:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0ca00, rc 0) 00000100:00100000:3.0:1788836287.466830:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+60:11627:x1875730518598784:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3939us (4169us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788836287.466838:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:1.0:1788836287.469910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836287.469996:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599168 00000100:00100000:2.0:1788836287.470010:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599168 00000100:00100000:2.0:1788836287.470093:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788836287.470105:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047941450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+60:11627:x1875730518599168:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:2.0:1788836287.470121:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836287.470149:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998000/0xcb5b7bc40b90a106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa22 expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836287.470168:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836287.470172:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836287.470229:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047941450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518599168:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 128us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836287.470254:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788836287.471841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.471931:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599296 00000100:00100000:0.0:1788836287.471940:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599296 00000100:00100000:0.0:1788836287.471991:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:0.0:1788836287.472001:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518599296:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1788836287.472113:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.472130:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836287.472142:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836287.472426:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788836287.472547:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518599296:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 547us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836287.472555:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:1.0:1788836287.474180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836287.474280:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599424 00000100:00100000:0.0:1788836287.474288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599424 00000100:00100000:3.0:1788836287.474495:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1788836287.474517:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+59:11627:x1875730518599424:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836287.474537:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836287.474557:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa53 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474612:0:8192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474624:0:8192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 60 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474640:0:8192:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474649:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 60 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474666:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836287.474668:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836287.474672:0:8192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 60 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836287.474679:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c400, rc 0) 00000100:00100000:3.0:1788836287.474754:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+60:11627:x1875730518599424:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 239us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836287.474762:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00010000:00010000:3.0:1788836288.274388:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836288.400588:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836288.400597:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836288.400630:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788836288.400637:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836288.400761:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538506624:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836288.400868:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836288.417096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.417228:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538506624:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836288.417466:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599552 00000100:00100000:3.0:1788836288.417473:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599552 00000100:00100000:3.0:1788836288.417532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:3.0:1788836288.417542:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+60:11628:x1875730518599552:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836288.417569:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836288.417872:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+60:11628:x1875730518599552:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 322us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.417881:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1788836288.431859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.432015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599680 00000100:00100000:0.0:1788836288.432026:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599680 00000100:00100000:0.0:1788836288.432102:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:0.0:1788836288.432113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+60:11628:x1875730518599680:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.432191:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432209:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432222:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432238:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432246:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432252:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432276:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432285:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432292:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836288.432328:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788836288.432374:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836288.432388:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432401:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432408:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432425:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432431:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.432436:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432443:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:0.0:1788836288.432459:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.432464:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432470:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a1c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432484:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432494:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432508:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432513:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.432515:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432522:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432530:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bd0498edc00) 00010000:00010000:0.0:1788836288.432532:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.432535:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432540:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432555:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432562:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432567:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432572:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.432574:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432591:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432599:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836288.432802:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.432807:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.432814:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.433035:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+60:11628:x1875730518599680:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 920us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.433045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:1.0:1788836288.440218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.440437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518599936 00000100:00100000:0.0:1788836288.440449:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518599936 00000100:00100000:0.0:1788836288.440556:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:0.0:1788836288.440567:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+60:11628:x1875730518599936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.440589:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836288.440620:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa5a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440721:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440747:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440761:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836288.440787:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788836288.440897:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440906:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440914:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440920:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.440924:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440931:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440945:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836288.440948:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788836288.440953:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.440959:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a1df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.441005:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa5a expref: 62 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.441016:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:0.0:1788836288.441019:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836288.441030:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a1d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa5a expref: 62 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.441041:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d000, rc 0) 00000100:00100000:0.0:1788836288.441113:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518599936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 547us (905us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788836288.441121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1788836288.447429:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.447596:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518600064 00000100:00100000:0.0:1788836288.447616:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518600064 00000100:00100000:0.0:1788836288.447683:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:0.0:1788836288.447695:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518600064:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836288.447738:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836288.447849:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518600064:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 157us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.447858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:1.0:1788836288.458320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.458404:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518600320 00000100:00100000:3.0:1788836288.458415:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518600320 00000100:00100000:3.0:1788836288.458478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:3.0:1788836288.458487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518600320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836288.458514:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836288.458517:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788836288.458546:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217de00/0xcb5b7bc40b90a17d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa3e expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.458577:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836288.458582:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836288.458596:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a1ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa61 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788836288.459001:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788836288.459206:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.459219:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.459228:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.459288:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a1ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa61 expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.459303:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa61 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.459311:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:3.0:1788836288.459313:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836288.459316:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836288.459425:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+62:11628:x1875730518600320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 939us (1115us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788836288.459433:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:1.0:1788836288.464942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.465112:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518600576 00000100:00100000:0.0:1788836288.465122:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518600576 00000100:00100000:0.0:1788836288.465190:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:0.0:1788836288.465201:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+62:11628:x1875730518600576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.465272:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836288.465300:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c800/0xcb5b7bc40b90a1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa61 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465321:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2500) 00010000:00010000:0.0:1788836288.465331:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836288.465394:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465427:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465436:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465450:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465456:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465462:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465531:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465537:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465543:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465548:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.465553:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465561:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465569:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836288.465576:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.465581:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465586:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a202 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465595:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465600:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465605:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465610:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.465613:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465618:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465624:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcaa1c808 (ffff9bd0498edc00) 00010000:00010000:0.0:1788836288.465626:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.465629:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.465634:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a209 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcaa1c808 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.465716:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518600576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 517us (783us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836288.466233:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:2.0:1788836288.470328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.471267:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518600704 00000100:00100000:3.0:1788836288.471280:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518600704 00000100:00100000:3.0:1788836288.471363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:3.0:1788836288.471376:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+61:11628:x1875730518600704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836288.471398:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836288.471420:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa68 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471455:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471469:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471481:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471586:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471616:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.471625:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:3.0:1788836288.471628:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836288.471631:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0de00, rc 0) 00000100:00100000:3.0:1788836288.471693:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+62:11628:x1875730518600704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 321us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.471699:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:2.0:1788836288.478417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.478604:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518600960 00000100:00100000:3.0:1788836288.478614:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518600960 00000100:00100000:3.0:1788836288.478675:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:3.0:1788836288.478683:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+62:11628:x1875730518600960:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836288.478778:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.478795:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.478806:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836288.479054:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788836288.479065:0:8192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341613721021ns, next at 342613718651ns, rc = 0 00000004:00010000:3.0:1788836288.479166:0:8192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5ee9770 reply state 000000000c8cb691 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.479175:0:8192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836288.479284:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+64:11628:x1875730518600960:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 599us (876us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788836288.479291:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:1.0:1788836288.484514:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.484659:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601088 00000100:00100000:0.0:1788836288.484668:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601088 00000100:00100000:0.0:1788836288.484741:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:0.0:1788836288.484752:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+64:11628:x1875730518601088:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.484777:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836288.484800:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa6f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.484866:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 65 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.484880:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 65 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.484896:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:0.0:1788836288.484899:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836288.484903:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d200, rc 0) 00000100:00100000:0.0:1788836288.484959:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+65:11628:x1875730518601088:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 209us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.484965:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00010000:00010000:3.0:1788836288.485990:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486004:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486011:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486037:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836288.486042:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486049:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486064:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:3.0:1788836288.486067:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836288.486071:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.486078:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0da00/0xcb5b7bc40b90a21e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.495761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836288.495872:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601216 00000100:00100000:1.0:1788836288.495882:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601216 00000100:00100000:1.0:1788836288.495966:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788836288.495975:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+9:2354:x1875730518601216:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788836288.496456:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+10:2354:x1875730518601216:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 480us (702us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788836288.496464:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:3.0:1788836288.497403:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836288.500240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.501817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601472 00000100:00100000:2.0:1788836288.501833:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601472 00000100:00100000:2.0:1788836288.501913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788836288.501925:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+64:11628:x1875730518601472:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836288.502523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+65:11628:x1875730518601472:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 599us (2292us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788836288.502531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788836288.507822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.508411:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601728 00000100:00100000:3.0:1788836288.508421:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601728 00000100:00100000:3.0:1788836288.508496:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:3.0:1788836288.508507:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+65:11628:x1875730518601728:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788836288.508629:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+65:11628:x1875730518601728:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 124us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.508637:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:1.0:1788836288.512692:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.512827:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601856 00000100:00100000:0.0:1788836288.512845:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601856 00000100:00100000:0.0:1788836288.512921:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:0.0:1788836288.512929:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+65:11628:x1875730518601856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.512949:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836288.512980:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a22c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa76 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513052:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513064:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513071:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836288.513101:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836288.513114:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513133:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a22c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa76 expref: 67 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513145:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa76 expref: 66 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.513151:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:0.0:1788836288.513153:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788836288.513156:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c000, rc 0) 00000100:00100000:0.0:1788836288.513207:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+66:11628:x1875730518601856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 278us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.513217:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:1.0:1788836288.517695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.517995:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518601984 00000100:00100000:2.0:1788836288.518007:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518601984 00000100:00100000:2.0:1788836288.518074:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1788836288.518084:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+10:2354:x1875730518601984:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836288.518110:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836288.518135:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa7d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836288.518184:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f79bf, blocks: 0x1 00010000:00010000:2.0:1788836288.518206:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788836288.518211:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836288.518220:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.518237:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.518329:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836288.518415:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+11:2354:x1875730518601984:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 331us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.518422:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788836288.522202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.522946:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602240 00000100:00100000:3.0:1788836288.522959:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602240 00000100:00100000:3.0:1788836288.523071:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:3.0:1788836288.523084:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+66:11628:x1875730518602240:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788836288.523216:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+66:11628:x1875730518602240:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 134us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.524074:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:1.0:1788836288.526403:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.526657:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602368 00000100:00100000:0.0:1788836288.526667:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602368 00000100:00100000:0.0:1788836288.526744:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788836288.526754:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+11:11628:x1875730518602368:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.526772:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836288.526791:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa84 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.526831:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.526841:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836288.526845:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836288.526850:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.526886:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.526901:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.526916:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538506752:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836288.527038:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836288.529856:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875730538506752:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836288.529968:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.530014:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d000, rc 0) 00000100:00100000:1.0:1788836288.530023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.530081:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+12:11628:x1875730518602368:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3328us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.530090:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788836288.530098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602496 00000100:00100000:2.0:1788836288.530104:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602496 00010000:00010000:2.0:1788836288.530136:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.530175:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788836288.530184:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+12:2353:x1875730518602496:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836288.530198:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836288.530219:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.530246:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.530271:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a23a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa7d expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.530286:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836288.530291:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836288.530299:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.530309:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.530377:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.530394:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875730538506880:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788836288.531332:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836288.533379:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1875730538506880:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788836288.533412:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836288.533570:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+11:2353:x1875730518602496:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3385us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.533581:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788836288.535535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836288.535744:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602624 00000100:00100000:1.0:1788836288.535755:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602624 00002000:00100000:1.0:1788836288.535823:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bd07af26d80 x1875730518602624/t0(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:454/0 lens 504/0 e 0 to 0 dl 1788836299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836288.535836:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07af26d80 with x1875730518602624 ext(0->12) 00002000:00010000:1.0:1788836288.535843:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07af26d80 00000100:00100000:1.0:1788836288.535892:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836288.535922:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+11:2353:x1875730518602624:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788836288.536815:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:539937c3-f568-41e1-b7b5-fe9413243b52+13:2353:x1875730518602624:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 893us (1285us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788836288.536825:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00100000:1.0:1788836288.536837:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9bd07af26d80 x1875730518602624/t4294967320(0) o4->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:454/0 lens 504/448 e 0 to 0 dl 1788836299 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788836288.536846:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd07af26d80 with x1875730518602624 ext(0->12) 00002000:00010000:1.0:1788836288.536851:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd07af26d80 00000100:00100000:1.0:1788836288.539833:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.540038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602752 00000100:00100000:2.0:1788836288.540049:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602752 00000100:00100000:2.0:1788836288.540111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1788836288.540121:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+66:11628:x1875730518602752:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788836288.611506:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:0.0:1788836288.611528:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788836288.611557:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd047ae8240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788836288.611561:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd047837f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd047ae8300 00000020:00080000:0.0:1788836288.611565:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd047f12900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07a77f400 00000001:00080000:0.0:1788836288.611585:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788836288.611605:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788836288.611631:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788836288.611651:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd054bced80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788836288.611654:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048bd3300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd054bcec00 00000020:00080000:0.0:1788836288.611657:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd048bd3200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd07af54400 00000020:00080000:0.0:1788836288.611796:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788836288.612273:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788836288.612383:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538507008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788836288.612453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836288.612712:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836288.612721:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538507136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788836288.612760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836288.612814:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538507264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788836288.612982:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538507008 00000100:00100000:1.0:1788836288.612991:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538507008 00000100:00100000:1.0:1788836288.613048:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538507136 00000100:00100000:1.0:1788836288.613051:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538507136 00000100:00100000:1.0:1788836288.613083:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788836288.613092:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538507008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788836288.613120:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788836288.613155:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f79bd, atime: 0x6a9f79bd, ctime: 0x6a9f79bd, blocks: 0x1 00010000:00010000:1.0:1788836288.613163:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.613180:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788836288.613184:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836288.613191:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.613207:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.613224:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.613232:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.613251:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836288.613740:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836288.613783:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538507264 00000100:00100000:0.0:1788836288.613787:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538507264 00000100:00100000:0.0:1788836288.613808:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788836288.613815:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538507136:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836288.614217:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875730538507008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1125us (1763us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788836288.614225:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788836288.614242:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836288.614248:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875730538507264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788836288.614364:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788836288.614368:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788836287 00002000:00010000:1.0:1788836288.614370:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788836288.614372:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788836287 -> 1788836287 00002000:00010000:1.0:1788836288.614374:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788836288.614403:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1875730538507264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (672us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788836288.614409:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788836288.614432:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836288.614442:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836288.614448:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.614468:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836288.614472:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.614481:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788836288.614662:0:12003:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788836288.614680:0:12003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.614695:0:12003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.614702:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788836288.614705:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788836288.614709:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.614748:0:12003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.614761:0:12003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 12 pid: 6683 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.614774:0:12003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12003:1875730538507392:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836288.614987:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:11628:x1875730518602752:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 74867us (75161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.614995:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1788836288.615104:0:12003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980ccc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788836288.615691:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07af27480/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788836288.615699:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538507264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788836288.615727:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07af26680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788836288.615744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538507008:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788836288.615827:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.615911:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007224f4dd/0xcb5b7bc40b90a248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.615935:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836288.615937:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836288.615939:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836288.624739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.624889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.625455:0:12003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12003:1875730538507392:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836288.625501:0:12003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.625768:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603008 00000100:00100000:3.0:1788836288.625775:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603008 00010000:00010000:3.0:1788836288.625812:0:6697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 13 pid: 6683 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.625860:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1788836288.625869:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+13:2353:x1875730518603008:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836288.625883:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836288.625888:0:6697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 13 pid: 6683 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.625901:0:6697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 13 pid: 6683 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.625926:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000692c9db0/0xcb5b7bc40b90a00a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9e3 expref: 13 pid: 6683 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.625943:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836288.625948:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836288.625954:0:6697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.625984:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.626012:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836288.626166:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:539937c3-f568-41e1-b7b5-fe9413243b52+12:2353:x1875730518603008:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 297us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.626174:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1788836288.627062:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518602880 00000100:00100000:1.0:1788836288.627071:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518602880 00000100:00100000:1.0:1788836288.627111:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1788836288.627120:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+12:2354:x1875730518602880:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.627408:0:12003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.627421:0:12003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.627433:0:12003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.627441:0:12003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.627461:0:12003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836288.630696:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1875730538507136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16873us (17926us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788836288.630711:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788836288.630740:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836288.630750:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.630764:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217ca00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836288.630769:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.630780:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.630800:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.630807:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b86a52/0xcb5b7bc40b90a24f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.630826:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836288.630828:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836288.630840:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788836288.632209:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07af24380/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788836288.634886:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538507136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788836288.693374:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:539937c3-f568-41e1-b7b5-fe9413243b52+12:2354:x1875730518602880:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 66212us (68610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836288.693389:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000001:00080000:1.0:1788836288.693428:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788836288.693436:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788836288.699315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.699446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603264 00000100:00100000:0.0:1788836288.699456:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603264 00000100:00100000:0.0:1788836288.699533:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:0.0:1788836288.699543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+20:11628:x1875730518603264:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.699593:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836288.699618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa76 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.699637:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:0.0:1788836288.699642:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836288.699669:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.699683:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.699693:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836288.699974:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c4ef129 reply state 00000000b8432b5e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.699984:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836288.700078:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+21:11628:x1875730518603264:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 536us (771us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788836288.700086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:1.0:1788836288.715825:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836288.715865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836288.715891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836288.715995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1788836288.716517:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716531:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716539:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716546:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836288.716551:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716559:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716580:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:3.0:1788836288.716583:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836288.716599:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.716606:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d600/0xcb5b7bc40b90a256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.716639:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603392 00000100:00100000:3.0:1788836288.716648:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603392 00000100:00100000:3.0:1788836288.716689:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603648 00000100:00100000:3.0:1788836288.716691:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603648 00000100:00100000:3.0:1788836288.716717:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788836288.716725:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518603648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836288.716798:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518603648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.716805:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788836288.716818:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788836288.716823:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0799a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2356:x1875730518603392:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788836288.717015:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788836288.717597:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788836287 -> 1788836286 00002000:00010000:3.0:1788836288.717601:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788836285 00002000:00010000:3.0:1788836288.717603:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788836287 -> 1788836286 00002000:00010000:3.0:1788836288.717605:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788836288.717606:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603776 00000100:00100000:0.0:1788836288.717612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603776 00000100:00100000:3.0:1788836288.717642:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0799a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2356:x1875730518603392:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 817us (1827us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788836288.717650:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00080000:3.0:1788836288.717671:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836288.717675:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836288.718055:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518603520 00000100:00100000:2.0:1788836288.718060:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518603520 00000100:00100000:2.0:1788836288.718097:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:2.0:1788836288.718104:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518603520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836288.718153:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518603520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 49us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.718159:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:0.0:1788836288.719010:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:0.0:1788836288.719021:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518603776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836288.719084:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518603776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.719105:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:3.0:1788836288.722969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.723136:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604032 00000100:00100000:0.0:1788836288.723146:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604032 00000100:00100000:0.0:1788836288.723199:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:0.0:1788836288.723209:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+20:11628:x1875730518604032:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.723277:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.723294:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.723305:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.723340:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.723385:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 20 pid: 5830 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.723399:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538507520:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836288.723509:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836288.727228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.727319:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604160 00000100:00100000:2.0:1788836288.727328:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604160 00010000:00010000:2.0:1788836288.727408:0:8494:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 21 pid: 5830 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.727452:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:2.0:1788836288.727462:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+21:2353:x1875730518604160:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836288.727477:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836288.727501:0:8494:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 21 pid: 5830 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.727516:0:8494:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 21 pid: 5830 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.727539:0:8494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:2.0:1788836288.727544:0:8494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.727555:0:8494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.727580:0:8494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.727600:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836288.727649:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:539937c3-f568-41e1-b7b5-fe9413243b52+21:2353:x1875730518604160:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.727657:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00010000:00010000:0.0:1788836288.728986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0de00/0xcb5b7bc40b90a217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa68 expref: 20 pid: 5830 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.729010:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1875730538507520:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836288.729097:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729122:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729129:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729163:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729170:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729178:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729184:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.729188:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729195:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729212:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:0.0:1788836288.729215:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788836288.729219:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.729225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a25d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.729316:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:11628:x1875730518604032:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 6107us (6355us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788836288.729331:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:1.0:1788836288.734247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.734393:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604288 00000100:00100000:3.0:1788836288.734418:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604288 00000100:00100000:3.0:1788836288.734484:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1788836288.734497:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518604288:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788836288.734586:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.734610:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.734620:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836288.734625:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836288.734629:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.734669:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.734685:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 8 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.734700:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538507648:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836288.734798:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836288.744394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.744810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604416 00000100:00100000:3.0:1788836288.744820:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604416 00010000:00010000:3.0:1788836288.744879:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.744966:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1788836288.744977:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2355:x1875730518604416:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836288.744992:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836288.745016:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.745044:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 9 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.745072:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836288.745076:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836288.745082:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.745093:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.745114:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836288.745194:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+9:2355:x1875730518604416:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 219us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836288.745203:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00010000:00010000:2.0:1788836288.747839:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f89aaff/0xcb5b7bc40b90a241 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa84 expref: 8 pid: 6680 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.747868:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875730538507648:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836288.747895:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747908:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747916:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747958:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747967:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747977:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.747984:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836288.747989:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.748021:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.748043:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.748050:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c76a8a5/0xcb5b7bc40b90a264 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.748154:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2354:x1875730518604288:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 13659us (13918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.748164:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:1.0:1788836288.755674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.755779:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604672 00000100:00100000:0.0:1788836288.755789:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604672 00000100:00100000:0.0:1788836288.755911:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:0.0:1788836288.755922:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:11628:x1875730518604672:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788836288.755996:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756014:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756094:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756288:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756299:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756307:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756340:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.756402:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 20 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836288.756437:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538507776:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788836288.757462:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836288.763985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.764162:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538507776:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836288.764192:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.766488:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604800 00000100:00100000:2.0:1788836288.766506:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604800 00010000:00010000:2.0:1788836288.766562:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 21 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.766758:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1788836288.766771:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:2353:x1875730518604800:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836288.766788:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836288.766796:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 21 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766811:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 21 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766853:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d200/0xcb5b7bc40b90a225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa6f expref: 21 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766873:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:2.0:1788836288.766878:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766889:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766898:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.766935:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836288.767063:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:539937c3-f568-41e1-b7b5-fe9413243b52+20:2353:x1875730518604800:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 295us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.767072:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00010000:00010000:1.0:1788836288.767098:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.767110:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836288.767324:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788836288.767503:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788836288.767549:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788836288.767630:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875730538507904:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788836288.767683:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836288.767718:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836288.767764:0:12002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538507904 00000100:00100000:0.0:1788836288.767771:0:12002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538507904 00000100:00100000:0.0:1788836288.768167:0:12002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836288.768181:0:12002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5829:x1875730538507904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788836288.768269:0:12002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5829:x1875730538507904:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.768277:0:12002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836288.776686:0:5829:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788836288.776697:0:5829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788836288.776724:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07af27480, transno 4294967321 00000100:00100000:1.0:1788836288.776988:0:5829:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd07af24380 x1875730538507136/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788836304 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836288.777001:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875730538507904:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788836288.786581:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788836288.786706:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875730538508032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788836288.786792:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836288.786837:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836288.786944:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538508032 00000100:00100000:2.0:1788836288.786954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538508032 00000100:00100000:2.0:1788836288.787025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836288.787035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1875730538508032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788836288.787294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5829:x1875730538508032:12345-0@lo:1000:mdt00_000.0 Request processed in 259us (499us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788836288.787303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836288.787558:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1875730538508032:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788836288.787600:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787609:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787616:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787622:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217da00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836288.787627:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787634:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787650:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd0452e2a00) 00010000:00010000:1.0:1788836288.787653:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836288.787657:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787663:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217da00/0xcb5b7bc40b90a272 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787690:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787697:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787714:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787719:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836288.787722:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787738:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787747:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:1.0:1788836288.787749:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836288.787756:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787766:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787775:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836288.787804:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 23 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836288.787816:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538508160:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788836288.788241:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836288.800038:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1875730538508160:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788836288.800177:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800189:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a1b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800225:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800810:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800825:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800860:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800866:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800873:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800880:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.800885:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800894:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800907:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836288.800910:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.800914:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.800920:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a279 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801576:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801584:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801594:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801779:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.801783:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801790:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801801:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836288.801804:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836288.801807:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.801825:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a26b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836288.802202:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836288.802212:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788836288.802223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+23:11628:x1875730518604672:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 46302us (46560us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788836288.802599:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000020:00080000:0.0:1788836288.802614:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788836288.802817:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788836288.802832:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836288.803338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.803560:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518604928 00000100:00100000:2.0:1788836288.803569:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518604928 00000100:00100000:2.0:1788836288.803785:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1788836288.803795:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:11627:x1875730518604928:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:2.0:1788836288.804101:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+23:11627:x1875730518604928:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 306us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.804206:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1788836288.805740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836288.806117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518605184 00000100:00100000:2.0:1788836288.806128:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518605184 00000100:00100000:2.0:1788836288.806180:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788836288.806188:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d28050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+23:11628:x1875730518605184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836288.807162:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836288.807267:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788836288.807317:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807333:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807363:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807372:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807378:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807384:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807409:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836288.807697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d28050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:11628:x1875730518605184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1297us (1762us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788836288.807707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:2.0:1788836288.807713:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788836288.807786:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836288.807793:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807801:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836288.807804:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807812:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.807826:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836288.808154:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788836288.808161:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.808168:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998600/0xcb5b7bc40b90a280 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.808195:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836288.808197:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836288.808199:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836288.814948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.815135:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518605440 00000100:00100000:3.0:1788836288.815145:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518605440 00000100:00100000:3.0:1788836288.815196:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:3.0:1788836288.815206:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+25:11627:x1875730518605440:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:2.0:1788836288.815706:0:8192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788836288.815809:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+25:11627:x1875730518605440:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 601us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.815831:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:2.0:1788836288.841828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.841946:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518605568 00000100:00100000:3.0:1788836288.841957:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518605568 00000100:00100000:3.0:1788836288.842030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:3.0:1788836288.842039:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+25:11630:x1875730518605568:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836288.842069:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836288.842095:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa8b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842161:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842175:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842187:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842203:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842209:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842232:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842761:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842775:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 26 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836288.842783:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.842965:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 26 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.842981:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 26 pid: 8192 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.842998:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538508288:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836288.843116:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836288.847757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836288.849015:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1875730538508288:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836288.849046:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836288.857106:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518605824 00000100:00100000:3.0:1788836288.857125:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518605824 00000100:00100000:3.0:1788836288.857191:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788836288.857202:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+27:5589:x1875730518605824:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788836288.858476:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+28:5589:x1875730518605824:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 1268us (10724us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788836288.858487:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788836288.865839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836288.866328:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518605952 00000100:00100000:3.0:1788836288.866683:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518605952 00010000:00010000:2.0:1788836288.867187:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 28 pid: 8192 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836288.867233:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1788836288.867243:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+28:2354:x1875730518605952:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836288.867257:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836288.867265:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 28 pid: 8192 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867279:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 28 pid: 8192 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867305:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0ca00/0xcb5b7bc40b90a1a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa4c expref: 28 pid: 8192 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867465:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836288.867472:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867481:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867488:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836288.867531:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836288.867588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:539937c3-f568-41e1-b7b5-fe9413243b52+27:2354:x1875730518605952:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 346us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836288.867594:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00010000:00010000:0.0:1788836288.867796:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867804:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836288.867871:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788836288.867875:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788836288.867895:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867908:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867917:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867924:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867931:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867937:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.867942:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867949:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867958:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:0.0:1788836288.867961:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.867965:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867970:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d000/0xcb5b7bc40b90a28e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867992:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.867997:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868002:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868007:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836288.868009:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868015:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868033:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd0452e2500) 00010000:00010000:0.0:1788836288.868035:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836288.868038:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868043:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d800/0xcb5b7bc40b90a295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868076:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d400/0xcb5b7bc40b90a287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa8b expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868088:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa8b expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836288.868103:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836288.868105:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836288.868107:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c600, rc 0) 00000100:00100000:0.0:1788836288.868148:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+26:11630:x1875730518605568:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 26109us (26330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836288.868154:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000001:00080000:2.0:1788836288.993254:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788836288.993280:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788836289.296498:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836289.809584:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836289.809597:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836289.809644:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788836289.809655:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788836289.809821:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538508416:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836289.809961:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045c3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836289.815750:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875730538508416:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836289.818024:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836289.818597:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518606080 00000100:00100000:0.0:1788836289.818611:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518606080 00000100:00100000:0.0:1788836289.818756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:0.0:1788836289.818768:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+26:11641:x1875730518606080:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788836289.818822:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788836289.818985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+26:11641:x1875730518606080:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 217us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836289.818994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00080000:3.0:1788836289.821865:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836289.824249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836289.824406:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518606336 00000100:00100000:0.0:1788836289.824420:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518606336 00000100:00100000:0.0:1788836289.824503:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:0.0:1788836289.824515:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+26:11641:x1875730518606336:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836289.824544:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836289.824573:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a2a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa92 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836289.824730:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a2aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836289.824767:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836289.824783:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a2aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836289.824797:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788836289.825288:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a2a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa92 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836289.825311:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a2aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa92 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836289.825321:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836289.825324:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788836289.825329:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c400, rc 0) 00000100:00100000:0.0:1788836289.825653:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:539937c3-f568-41e1-b7b5-fe9413243b52+28:11641:x1875730518606336:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1139us (1416us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788836289.825661:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:3.0:1788836289.838909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836289.840040:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518606464 00000100:00100000:2.0:1788836289.840057:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518606464 00000100:00100000:2.0:1788836289.840160:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788836289.840173:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047942450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+28:2354:x1875730518606464:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836289.840210:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836289.840242:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a2aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa92 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.840266:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836289.840272:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836289.840373:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047942450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:539937c3-f568-41e1-b7b5-fe9413243b52+27:2354:x1875730518606464:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 202us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836289.840381:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788836289.842991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836289.843393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518606720 00000100:00100000:2.0:1788836289.843407:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518606720 00000100:00100000:2.0:1788836289.843475:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:2.0:1788836289.843596:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+27:11641:x1875730518606720:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788836289.843710:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.843742:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.843758:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844050:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844059:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844067:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844230:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836289.844238:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844248:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844266:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836289.844270:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836289.844276:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836289.844284:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a2b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836289.845842:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+28:11641:x1875730518606720:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 2236us (2851us total) trans 4294967517 rc 0/0 00000040:00080000:2.0:1788836289.848963:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788836289.848976:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836289.849539:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788836289.849552:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788836289.850692:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:1.0:1788836289.853984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836289.856867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518606976 00000100:00100000:2.0:1788836289.856889:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518606976 00000100:00100000:2.0:1788836289.856997:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788836289.857011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+28:11641:x1875730518606976:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836289.857385:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+29:11641:x1875730518606976:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 376us (3414us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788836289.857396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000040:00080000:3.0:1788836290.132886:0:12498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788836290.132896:0:12498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836290.132953:0:12498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788836290.132960:0:12498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788836290.325287:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836290.344931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836290.345025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607232 00000100:00100000:0.0:1788836290.345038:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607232 00000100:00100000:0.0:1788836290.345115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:0.0:1788836290.345128:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+29:11654:x1875730518607232:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788836290.345162:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836290.345189:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a2bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aa99 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836290.345371:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a2c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836290.345390:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836290.345406:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836290.345419:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788836290.345904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a2bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa99 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836290.345927:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa99 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836290.345936:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:0.0:1788836290.345940:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788836290.345944:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c600, rc 0) 00000100:00100000:0.0:1788836290.346064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+31:11654:x1875730518607232:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 937us (1145us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788836290.346072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:1.0:1788836290.365711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836290.365773:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607360 00000100:00100000:1.0:1788836290.365786:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607360 00000100:00100000:1.0:1788836290.365853:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:1.0:1788836290.365864:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+31:11654:x1875730518607360:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788836290.365950:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.365972:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.365986:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366020:0:8192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366028:0:8192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366036:0:8192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366043:0:8192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978bc00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836290.366048:0:8192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366056:0:8192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366070:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:1.0:1788836290.366089:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836290.366096:0:8192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836290.366103:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978bc00/0xcb5b7bc40b90a2d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836290.366188:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:539937c3-f568-41e1-b7b5-fe9413243b52+31:11654:x1875730518607360:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 325us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836290.366197:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1788836290.390750:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538508544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836290.390846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836290.391049:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538508928:0@lo:400:kworker.0 00000100:00100000:1.0:1788836290.391101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836290.391148:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538508928 00000100:00100000:1.0:1788836290.391157:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538508928 00000100:00100000:1.0:1788836290.391226:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788836290.391237:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538508928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836290.391299:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538508928:12345-0@lo:400:kworker.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836290.391306:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788836290.391331:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836290.391383:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788836290.391390:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07ad1ca80, transno 4294967307 00000004:00080000:1.0:1788836290.391403:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788836290.391423:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07af26680, transno 4294967310 00000100:00100000:1.0:1788836290.391442:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538508928:0@lo:400:kworker.0 00000100:00100000:3.0:1788836290.395960:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538509056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836290.396069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836290.396145:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538508544 00000100:00100000:3.0:1788836290.396155:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538508544 00000100:00100000:3.0:1788836290.396212:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788836290.396222:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538508544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836290.396286:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538508544:12345-0@lo:400:kworker.0 Request processed in 65us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836290.396294:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788836290.396372:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538508544:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.396828:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538508672:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.396884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836290.396913:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538509184:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.396935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836290.396959:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836290.396966:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538508800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.396988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836290.397007:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538509312:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.397057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836290.397092:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509056 00000100:00100000:2.0:1788836290.397098:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509056 00000100:00100000:2.0:1788836290.397218:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836290.397227:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07963d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538509056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836290.397266:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836290.397305:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07963d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538509056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836290.397313:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836290.397694:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538509056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836290.398204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538508672 00000100:00100000:2.0:1788836290.398211:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538508672 00000100:00100000:2.0:1788836290.398257:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509184 00000100:00100000:2.0:1788836290.398260:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509184 00000100:00100000:2.0:1788836290.398287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538508800 00000100:00100000:2.0:1788836290.398290:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538508800 00000100:00100000:2.0:1788836290.398307:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836290.398314:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538508672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.398392:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538508672:12345-0@lo:400:kworker.0 Request processed in 78us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836290.398399:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836290.398427:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836290.398434:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538509184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836290.398651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788836290.398661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538508800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836290.398698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538508800:12345-0@lo:400:kworker.0 Request processed in 39us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836290.398703:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788836290.399603:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875730538509184:12345-0@lo:400:kworker.0 Request processed in 1163us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836290.399615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836290.399865:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538508800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.399884:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538508672:0@lo:400:kworker.0 00000100:00100000:2.0:1788836290.399896:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538509184:0@lo:400:kworker.0 00000100:00100000:1.0:1788836290.402433:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509312 00000100:00100000:1.0:1788836290.402957:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509312 00000100:00100000:1.0:1788836290.403038:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788836290.403051:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538509312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836290.403189:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538509312:12345-0@lo:400:kworker.0 Request processed in 140us (6130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836290.403197:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788836290.403401:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836290.403407:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836290.411517:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538509312:0@lo:400:kworker.0 00000100:00100000:1.0:1788836290.483182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836290.485575:0:12003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607488 00000100:00100000:2.0:1788836290.485605:0:12003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607488 00000100:00100000:2.0:1788836290.485987:0:12003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788836290.486012:0:12003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+7:2353:x1875730518607488:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788836290.486039:0:12003:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836290.486068:0:12003:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db289c49/0xcb5b7bc40b90a2db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aaa0 expref: -99 pid: 12003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836290.486116:0:12003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f79be, atime: 0x6a9f79bd, ctime: 0x6a9f79be, blocks: 0xb 00010000:00010000:2.0:1788836290.486148:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1788836290.486153:0:12003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836290.486165:0:12003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db289c49/0xcb5b7bc40b90a2db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa0 expref: 8 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836290.486187:0:12003:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db289c49/0xcb5b7bc40b90a2db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa0 expref: 8 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836290.486231:0:12003:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998a00, rc 0) 00000100:00100000:2.0:1788836290.486315:0:12003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:539937c3-f568-41e1-b7b5-fe9413243b52+8:2353:x1875730518607488:12345-192.168.203.52@tcp:101:cat.0 Request processed in 307us (3219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836290.486323:0:12003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00080000:1.0:1788836290.486820:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836290.494450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836290.494640:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607616 00000100:00100000:3.0:1788836290.494651:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607616 00002000:00100000:3.0:1788836290.494697:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bcf46d90000 x1875730518607616/t0(0) o3->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:456/0 lens 488/0 e 0 to 0 dl 1788836301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836290.494709:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bcf46d90000 with x1875730518607616 ext(0->4095) 00002000:00010000:3.0:1788836290.494736:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bcf46d90000 00000100:00100000:3.0:1788836290.494769:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788836290.494779:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2355:x1875730518607616:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:3.0:1788836290.496267:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2355:x1875730518607616:12345-192.168.203.52@tcp:3:cat.0 Request processed in 1482us (1819us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788836290.496279:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00002000:00100000:3.0:1788836290.496288:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9bcf46d90000 x1875730518607616/t0(0) o3->539937c3-f568-41e1-b7b5-fe9413243b52@192.168.203.52@tcp:456/0 lens 488/4536 e 0 to 0 dl 1788836301 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788836290.496298:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bcf46d90000 with x1875730518607616 ext(0->4095) 00002000:00010000:3.0:1788836290.496304:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bcf46d90000 00000100:00100000:0.0:1788836290.897332:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836290.897435:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538509440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836290.897561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836290.897807:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509440 00000100:00100000:1.0:1788836290.897819:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509440 00000100:00100000:1.0:1788836290.897887:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836290.897898:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875730538509440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836290.897956:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836290.898010:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875730538509440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836290.898018:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788836290.898072:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538509440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836291.344912:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836292.368480:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836292.944555:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836292.944567:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836292.944614:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788836292.944620:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788836293.403386:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836293.852973:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836293.853013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836293.853039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836293.853058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836293.853080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836293.853104:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608256 00000100:00100000:3.0:1788836293.853113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608256 00000100:00100000:3.0:1788836293.853162:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607872 00000100:00100000:3.0:1788836293.853166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607872 00000100:00100000:3.0:1788836293.853188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:3.0:1788836293.853197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518608256:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836293.853261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2354:x1875730518608256:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836293.853269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:3.0:1788836293.853285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:3.0:1788836293.853291:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+31:2354:x1875730518607872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836293.853330:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+31:2354:x1875730518607872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836293.853337:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:3.0:1788836293.853386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608000 00000100:00100000:3.0:1788836293.853390:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608000 00000100:00100000:3.0:1788836293.853415:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608128 00000100:00100000:3.0:1788836293.853418:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608128 00000100:00100000:3.0:1788836293.853437:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788836293.853445:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518608000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836293.853472:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2354:x1875730518608000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836293.853478:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788836293.853490:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1788836293.853496:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518608128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836293.853519:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+8:2354:x1875730518608128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836293.853524:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00080000:3.0:1788836293.853540:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836293.853544:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836293.853546:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836293.853789:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518607744 00000100:00100000:2.0:1788836293.853794:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518607744 00000100:00100000:2.0:1788836293.853830:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:2.0:1788836293.853837:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518607744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836293.853870:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46565d0b-6fff-423e-81f2-1747715bb465+13:2354:x1875730518607744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836293.853877:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00000001:00080000:0.0:1788836294.062805:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788836294.062820:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788836294.062825:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788836294.073719:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788836294.073743:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788836294.073768:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd047ae86c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788836294.073773:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd0487b1a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd047ae8600 00000020:00080000:1.0:1788836294.073777:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd069043500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bcf47125000 00000020:00080000:0.0:1788836294.076155:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788836294.076428:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788836294.419058:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836295.441219:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836295.504566:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538509952:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504704:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836295.504710:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538509568:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504753:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538510080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504794:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538509696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504827:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538510208:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504856:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836295.504861:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf46d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538509824:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.504890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836295.504917:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509952 00000100:00100000:1.0:1788836295.504924:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509952 00000100:00100000:1.0:1788836295.504968:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510208 00000100:00100000:1.0:1788836295.504971:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510208 00000100:00100000:1.0:1788836295.504998:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836295.505007:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538509952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505057:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538509952:12345-0@lo:400:kworker.0 Request processed in 51us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836295.505065:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836295.505080:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788836295.505087:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538510208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505117:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538510208:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836295.505132:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788836295.505152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510080 00000100:00100000:1.0:1788836295.505156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510080 00000100:00100000:1.0:1788836295.505178:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836295.505185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538510080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538510080:12345-0@lo:400:kworker.0 Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836295.505221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836295.505231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509696 00000100:00100000:1.0:1788836295.505233:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509696 00000100:00100000:1.0:1788836295.505245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509824 00000100:00100000:1.0:1788836295.505248:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509824 00000100:00100000:1.0:1788836295.505261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788836295.505266:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538509696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505290:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538509696:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836295.505295:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788836295.505306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788836295.505311:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538509824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505337:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538509824:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836295.505375:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788836295.505400:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836295.505404:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836295.505406:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836295.505437:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538509824:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505461:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538509696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505469:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788836295.505474:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07af24380, transno 4294967322 00000004:00080000:1.0:1788836295.505483:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788836295.505502:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538510208:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505530:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538510080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836295.505539:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538509952:0@lo:400:kworker.0 00000100:00100000:2.0:1788836295.505781:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538509568 00000100:00100000:2.0:1788836295.505786:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538509568 00000100:00100000:2.0:1788836295.505816:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788836295.505824:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836295.505865:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538509568:12345-0@lo:400:kworker.0 Request processed in 42us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836295.505884:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788836295.506206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf46d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538509568:0@lo:400:kworker.0 00000100:00100000:2.0:1788836295.513693:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836295.513715:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538510336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836295.513796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836295.513845:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510336 00000100:00100000:2.0:1788836295.513852:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510336 00000100:00100000:2.0:1788836295.513914:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788836295.513923:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538510336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836295.513957:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836295.513999:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538510336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836295.514006:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788836295.514051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538510336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836296.016788:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836296.016810:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538510464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836296.016875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836296.016943:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510464 00000100:00100000:2.0:1788836296.016950:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510464 00000100:00100000:2.0:1788836296.016997:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836296.017005:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538510464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836296.017041:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836296.017084:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538510464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836296.017091:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836296.017135:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538510464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836296.059759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836296.059882:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608384 00000100:00100000:3.0:1788836296.059892:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608384 00000100:00100000:3.0:1788836296.059963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:3.0:1788836296.059974:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+18:11315:x1875730518608384:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788836296.060136:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836296.060206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+18:11315:x1875730518608384:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 233us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836296.060227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:1.0:1788836296.064923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836296.066390:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608640 00000100:00100000:2.0:1788836296.066403:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608640 00000100:00100000:2.0:1788836296.066469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788836296.066481:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:11315:x1875730518608640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836296.066841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:11315:x1875730518608640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 361us (1927us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788836296.066849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:2.0:1788836296.465779:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836296.650895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836296.658645:0:8192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608768 00000100:00100000:1.0:1788836296.658672:0:8192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608768 00000100:00100000:1.0:1788836296.658805:0:8192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:1.0:1788836296.658818:0:8192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:12109:x1875730518608768:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:1.0:1788836296.658845:0:8192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836296.658874:0:8192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aaa7 expref: -99 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.658958:0:8192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.658975:0:8192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.658988:0:8192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836296.659057:0:8192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788836296.659062:0:8192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1788836296.659377:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1788836296.663024:0:8192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.663097:0:8192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa7 expref: 7 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.663126:0:8192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa7 expref: 6 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836296.663137:0:8192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:1.0:1788836296.663140:0:8192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788836296.663145:0:8192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b800, rc 0) 00000100:00100000:1.0:1788836296.663254:0:8192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:12109:x1875730518608768:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 4436us (12371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836296.663264:0:8192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00010000:00010000:2.0:1788836297.491216:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836298.512595:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836298.956268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836298.956427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836298.956453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836298.956484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836298.956520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836298.956554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609408 00000100:00100000:0.0:1788836298.956567:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609408 00000100:00100000:0.0:1788836298.956638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609024 00000100:00100000:0.0:1788836298.956642:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609024 00000100:00100000:0.0:1788836298.956687:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:0.0:1788836298.956699:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2356:x1875730518609408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836298.956800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2356:x1875730518609408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836298.956808:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:0.0:1788836298.956830:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1788836298.956836:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:2356:x1875730518609024:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836298.956867:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:2356:x1875730518609024:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836298.956874:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1788836298.956914:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609152 00000100:00100000:0.0:1788836298.956918:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609152 00000100:00100000:0.0:1788836298.956947:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609280 00000100:00100000:0.0:1788836298.956950:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609280 00000100:00100000:0.0:1788836298.956972:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788836298.956979:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518609152:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836298.957008:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2356:x1875730518609152:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836298.957014:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788836298.957025:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788836298.957031:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2356:x1875730518609280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836298.957054:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+7:2356:x1875730518609280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836298.957060:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00080000:2.0:1788836298.957312:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836298.957318:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836298.957321:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836298.957985:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518608896 00000100:00100000:3.0:1788836298.957994:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518608896 00000100:00100000:3.0:1788836298.958088:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:3.0:1788836298.958099:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518608896:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836298.958161:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+13:2356:x1875730518608896:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 64us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836298.958168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 298 00000020:00080000:1.0:1788836299.169503:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788836299.169527:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788836299.169569:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788836299.169581:0:5862:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788836299.536562:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836300.026873:0:12702:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:58:17 (1788836297) 00010000:00010000:2.0:1788836300.560611:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836300.628641:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538510592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836300.628721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.629050:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510592 00000100:00100000:2.0:1788836300.629059:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510592 00000100:00100000:2.0:1788836300.629130:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836300.629140:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538510592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836300.629176:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836300.629227:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538510592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836300.629235:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836300.629293:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538510592:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836300.629752:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836300.631862:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538510848:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.631926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.631972:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788836300.631979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538510720:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.632027:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538511232:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.632082:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538511104:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.632117:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836300.632122:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538510976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836300.632162:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510848 00000100:00100000:2.0:1788836300.632169:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510848 00000100:00100000:2.0:1788836300.632204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511104 00000100:00100000:2.0:1788836300.632206:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511104 00000100:00100000:2.0:1788836300.632220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510976 00000100:00100000:2.0:1788836300.632222:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510976 00000100:00100000:2.0:1788836300.632234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788836300.632241:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538510848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632284:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538510848:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836300.632291:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788836300.632305:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836300.632311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538511104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632338:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538511104:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836300.632363:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836300.632376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836300.632381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538510976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632407:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875730538510976:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836300.632413:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788836300.632869:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538510848:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632920:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538510976:0@lo:400:kworker.0 00000100:00100000:2.0:1788836300.632930:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538511104:0@lo:400:kworker.0 00000100:00100000:0.0:1788836300.633552:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511232 00000100:00100000:0.0:1788836300.633559:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511232 00000100:00100000:0.0:1788836300.633598:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836300.633605:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836300.633689:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538511232:12345-0@lo:400:kworker.0 Request processed in 84us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836300.633696:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836300.633729:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538511232:0@lo:400:kworker.0 00000100:00100000:0.0:1788836300.633771:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538510720 00000100:00100000:0.0:1788836300.633774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538510720 00000100:00100000:0.0:1788836300.633804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788836300.633810:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538510720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836300.633844:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3305:x1875730538510720:12345-0@lo:400:kworker.0 Request processed in 34us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836300.633850:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788836300.633885:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538510720:0@lo:400:kworker.0 00000100:00080000:3.0:1788836300.634229:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836300.634235:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836301.140489:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538511360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836301.140568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836301.140677:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511360 00000100:00100000:1.0:1788836301.140684:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511360 00000100:00100000:1.0:1788836301.140735:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836301.140745:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538511360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836301.140785:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836301.140856:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538511360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836301.140866:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836301.140928:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538511360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836301.584925:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836302.161899:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788836302.161908:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836302.162611:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788836302.162620:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788836302.618444:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836303.633641:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836303.713380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836303.713569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609664 00000100:00100000:2.0:1788836303.713579:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609664 00000100:00100000:2.0:1788836303.713665:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788836303.713677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+18:12330:x1875730518609664:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788836303.714069:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+19:12330:x1875730518609664:12345-192.168.203.52@tcp:35:umount.0 Request processed in 393us (735us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788836303.714077:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00080000:3.0:1788836303.714165:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836303.722987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836303.723175:0:11953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518609920 00000100:00100000:3.0:1788836303.723185:0:11953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518609920 00000100:00100000:3.0:1788836303.723243:0:11953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788836303.723254:0:11953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+19:12330:x1875730518609920:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:3.0:1788836303.723655:0:11953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:539937c3-f568-41e1-b7b5-fe9413243b52+20:12330:x1875730518609920:12345-192.168.203.52@tcp:35:umount.0 Request processed in 401us (677us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788836303.723663:0:11953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1788836303.726225:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836303.729117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518610176 00000100:00100000:0.0:1788836303.729137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518610176 00000100:00100000:0.0:1788836303.729285:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788836303.729296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd046d2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+20:12330:x1875730518610176:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1788836303.729554:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd046d2a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:12330:x1875730518610176:12345-192.168.203.52@tcp:35:umount.0 Request processed in 259us (3338us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788836303.729562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1788836303.734012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836303.734219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518610432 00000100:00100000:2.0:1788836303.734230:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518610432 00000100:00100000:2.0:1788836303.734296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1788836303.734310:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+21:12330:x1875730518610432:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788836303.734754:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:539937c3-f568-41e1-b7b5-fe9413243b52+22:12330:x1875730518610432:12345-192.168.203.52@tcp:35:umount.0 Request processed in 445us (752us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788836303.734762:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788836303.739211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836303.739258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836303.739290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836303.739321:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836303.739415:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518610944 00000100:00100000:1.0:1788836303.739425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518610944 00000100:00100000:1.0:1788836303.739484:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518611200 00000100:00100000:1.0:1788836303.739488:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518611200 00000100:00100000:1.0:1788836303.739507:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518611072 00000100:00100000:1.0:1788836303.739510:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518611072 00000100:00100000:1.0:1788836303.739528:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788836303.739538:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+15:2355:x1875730518610944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836303.739554:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836303.739577:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999000/0xcb5b7bc40b909361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a632 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836303.739598:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836303.739668:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+14:2355:x1875730518610944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 130us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836303.739675:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788836303.739708:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788836303.739724:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+13:2355:x1875730518611200:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836303.739733:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836303.739744:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90954b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6fd expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836303.739753:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836303.739775:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+12:2355:x1875730518611200:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 62us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836303.739781:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788836303.739796:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788836303.739807:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+11:2355:x1875730518611072:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836303.739814:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836303.739823:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2600/0xcb5b7bc40b9092c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a5fa expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836303.739834:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836303.740238:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518611072:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 433us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836303.740245:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788836303.741542:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518610816 00000100:00100000:3.0:1788836303.741557:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518610816 00000100:00100000:3.0:1788836303.741662:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:3.0:1788836303.741674:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+7:2352:x1875730518610816:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:3.0:1788836303.741705:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9098a1 00000020:00010000:3.0:1788836303.741724:0:6683:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd079849000: total 0 00000100:00080000:3.0:1788836303.741730:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9bd07984a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836303.741770:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788836303.742083:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:539937c3-f568-41e1-b7b5-fe9413243b52+5:2352:x1875730518610816:12345-192.168.203.52@tcp:9:umount.0 Request processed in 411us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836303.742093:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000020:00010000:3.0:1788836303.742118:0:5817:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd079849000: total 0 00010000:00010000:3.0:1788836303.742139:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd079849000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788836303.742210:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdedd658/0xcb5b7bc40b909c3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8d2 expref: 4 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.742249:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db289c49/0xcb5b7bc40b90a2db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa0 expref: 3 pid: 12003 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.742264:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd079849000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788836303.742276:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836303.742278:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836303.742281:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836303.744553:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836303.752261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836303.752922:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518611328 00000100:00100000:0.0:1788836303.752941:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518611328 00000100:00100000:0.0:1788836303.753037:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788836303.753047:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+5:2352:x1875730518611328:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:0.0:1788836303.753085:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909639 00000100:00080000:0.0:1788836303.753096:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bcf45114000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836303.753145:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788836303.753474:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:539937c3-f568-41e1-b7b5-fe9413243b52+2:2352:x1875730518611328:12345-192.168.203.52@tcp:9:umount.0 Request processed in 428us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836303.753495:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:3.0:1788836303.754200:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836303.754377:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836303.762450:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836303.762591:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518612352 00000100:00100000:2.0:1788836303.762602:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518612352 00000100:00100000:2.0:1788836303.762676:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:2.0:1788836303.762687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+22:2352:x1875730518612352:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:2.0:1788836303.762720:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9092d5 00000020:00010000:2.0:1788836303.762737:0:5830:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bcf448a7800: total 0 00000100:00080000:2.0:1788836303.762742:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3af800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836303.762789:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788836303.763161:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:539937c3-f568-41e1-b7b5-fe9413243b52+21:2352:x1875730518612352:12345-192.168.203.52@tcp:39:umount.0 Request processed in 475us (720us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788836303.763170:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000020:00010000:3.0:1788836303.763821:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bcf448a7800: total 0 00010000:00010000:3.0:1788836303.763876:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bcf448a7800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788836303.763912:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836303.763923:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836303.763944:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a200/0xcb5b7bc40b9098fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a7f9 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.763963:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd0498ed600) 00010000:00010000:3.0:1788836303.763966:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836303.763970:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da000/0xcb5b7bc40b90959f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a70b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.763989:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836303.763992:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788836303.763996:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b000/0xcb5b7bc40b909cbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8f5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764008:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd07a955100) 00010000:00010000:3.0:1788836303.764010:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836303.764013:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0d200/0xcb5b7bc40b909f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a9c7 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764027:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd0498ed800) 00010000:00010000:3.0:1788836303.764030:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788836303.764033:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820da400/0xcb5b7bc40b90960f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a727 expref: 16 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764046:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836303.764049:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836303.764052:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c400/0xcb5b7bc40b90a1bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa53 expref: 15 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764065:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836303.764073:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836303.764078:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd0820dae00/0xcb5b7bc40b909b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a885 expref: 14 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764092:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd07a955b00) 00010000:00010000:3.0:1788836303.764094:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836303.764098:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd060376800/0xcb5b7bc40b9095bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a712 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764112:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836303.764115:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836303.764118:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd042c0c600/0xcb5b7bc40b90a29c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa8b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764128:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836303.764131:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836303.764134:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999c00/0xcb5b7bc40b909c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8ee expref: 11 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764147:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836303.764150:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836303.764153:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b909bfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8bd expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764164:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd0498ed700) 00010000:00010000:3.0:1788836303.764166:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788836303.764169:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999a00/0xcb5b7bc40b909c28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a8cb expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764197:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836303.764199:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788836303.764202:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c600/0xcb5b7bc40b90a2c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aa99 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836303.764214:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bcf448a7800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788836303.764226:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836303.764228:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836303.764230:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836304.068886:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836304.069038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518612480 00000100:00100000:2.0:1788836304.069048:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518612480 00000100:00100000:2.0:1788836304.069126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:2.0:1788836304.069138:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2355:x1875730518612480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836304.069222:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2355:x1875730518612480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836304.069229:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00080000:1.0:1788836304.069493:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788836304.274145:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:1.0:1788836304.274154:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bcf45115800/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:1.0:1788836304.274182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45115800/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-OST0000 00000020:00000080:1.0:1788836304.274236:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45114000 for lustre-OST0000 00000001:00100000:1.0:1788836304.282168:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:1.0:1788836304.282178:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bd079849000/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:2.0:1788836304.282545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079849000/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-OST0001 00000020:00000080:2.0:1788836304.282599:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07984a000 for lustre-OST0001 00000001:00080000:1.0:1788836304.288587:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1788836304.288610:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 539937c3-f568-41e1-b7b5-fe9413243b52 00000001:00080000:1.0:1788836304.288620:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788836304.288641:0:5851:0:(genops.c:885:class_export_put()) final put ffff9bcf448a7800/539937c3-f568-41e1-b7b5-fe9413243b52 00000020:00000080:3.0:1788836304.288713:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf448a7800/539937c3-f568-41e1-b7b5-fe9413243b52 for lustre-MDT0000 00000020:00000080:3.0:1788836304.288783:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07a3af800 for lustre-MDT0000 00010000:00010000:3.0:1788836304.658137:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836305.326979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836305.327086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836305.327218:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836305.328149:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518612608 00000100:00100000:2.0:1788836305.328160:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518612608 00000100:00100000:2.0:1788836305.328236:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518612736 00000100:00100000:2.0:1788836305.328240:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518612736 00000100:00100000:2.0:1788836305.328269:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788836305.328279:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+11:2355:x1875730518612608:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836305.328294:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836305.328314:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b9093a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a647 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836305.328331:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836305.328668:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788836305.328681:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518612736:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836305.328690:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836305.328701:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b9093ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a671 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836305.328712:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836305.328744:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518612864 00000100:00100000:1.0:1788836305.328749:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518612864 00000100:00100000:0.0:1788836305.328776:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46565d0b-6fff-423e-81f2-1747715bb465+10:2355:x1875730518612736:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 98us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836305.328782:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788836305.328791:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788836305.328797:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+10:2356:x1875730518612864:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836305.328807:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836305.328820:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0cc00/0xcb5b7bc40b909544 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a6f6 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836305.328830:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836305.328854:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46565d0b-6fff-423e-81f2-1747715bb465+8:2356:x1875730518612864:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 63us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836305.328861:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836305.330159:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46565d0b-6fff-423e-81f2-1747715bb465+7:2355:x1875730518612608:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1873us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.330171:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788836305.343165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836305.343334:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613120 00000100:00100000:2.0:1788836305.343490:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613120 00000100:00100000:2.0:1788836305.343535:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:2.0:1788836305.343547:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+6:2352:x1875730518613120:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:2.0:1788836305.343590:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9093bc 00000020:00010000:2.0:1788836305.343598:0:5830:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bcf45112800: total 0 00000100:00080000:2.0:1788836305.343602:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9bcf45111800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836305.343639:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788836305.344034:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c48ba00-7f2e-4f58-b5e4-15aa91896ef5+5:2352:x1875730518613120:12345-192.168.203.52@tcp:39:umount.0 Request processed in 489us (879us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788836305.344043:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000020:00010000:3.0:1788836305.344192:0:6696:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bcf45112800: total 0 00010000:00010000:3.0:1788836305.344197:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836305.344233:0:6696:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bcf45112800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788836305.344266:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b300) 00010000:00010000:3.0:1788836305.344269:0:6696:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836305.344277:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b800/0xcb5b7bc40b90a2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaa7 expref: 4 pid: 8192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836305.344296:0:6696:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bcf45112800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788836305.344315:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836305.344317:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836305.344319:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836305.375079:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836305.375190:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613376 00000100:00100000:0.0:1788836305.375200:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613376 00000100:00100000:0.0:1788836305.375251:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:0.0:1788836305.375262:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+7:2352:x1875730518613376:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:0.0:1788836305.375305:0:5823:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9092b2 00000020:00010000:0.0:1788836305.375312:0:5823:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd079858800: total 0 00000100:00080000:0.0:1788836305.375317:0:5823:0:(import.c:65:import_set_state_nolock()) ffff9bd07985e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788836305.375422:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46565d0b-6fff-423e-81f2-1747715bb465+3:2352:x1875730518613376:12345-192.168.203.52@tcp:251:umount.0 Request processed in 161us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836305.375429:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 300 00000020:00010000:3.0:1788836305.375683:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd079858800: total 0 00010000:00010000:3.0:1788836305.375723:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd079858800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788836305.375764:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377400/0xcb5b7bc40b909368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316a639 expref: 2 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836305.375779:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd079858800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788836305.375787:0:5818:0:(genops.c:885:class_export_put()) final put ffff9bd079858800/46565d0b-6fff-423e-81f2-1747715bb465 00010000:00010000:3.0:1788836305.375804:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836305.375806:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836305.375807:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836305.375844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079858800/46565d0b-6fff-423e-81f2-1747715bb465 for MGS 00000020:00000080:1.0:1788836305.375888:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07985e000 for MGS 00010000:00010000:3.0:1788836305.681872:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836305.745532:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538511744:0@lo:400:kworker.0 00000100:00100000:1.0:1788836305.745573:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538511872:0@lo:400:kworker.0 00000100:00100000:1.0:1788836305.745640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836305.745714:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836305.745721:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538512000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836305.745746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.745824:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511872 00000100:00100000:2.0:1788836305.745832:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511872 00000100:00100000:2.0:1788836305.745887:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788836305.745896:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.745948:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538511872:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.745955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788836305.745980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.746002:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538512256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.746057:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836305.746063:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538511616:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.746110:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538511488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836305.746142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.746159:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538512128:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836305.746202:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511744 00000100:00100000:2.0:1788836305.746206:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511744 00000100:00100000:2.0:1788836305.746227:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512128 00000100:00100000:2.0:1788836305.746229:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512128 00000100:00100000:2.0:1788836305.746246:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788836305.746252:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746286:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538511744:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788836305.746305:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836305.746311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538512128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746337:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538512128:12345-0@lo:400:kworker.0 Request processed in 27us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746362:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788836305.746392:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512000 00000100:00100000:2.0:1788836305.746395:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512000 00000100:00100000:2.0:1788836305.746416:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512256 00000100:00100000:2.0:1788836305.746418:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512256 00000100:00100000:2.0:1788836305.746432:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836305.746437:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746463:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538512000:12345-0@lo:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746468:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788836305.746476:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836305.746486:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746506:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07b256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538512256:12345-0@lo:400:kworker.0 Request processed in 21us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746511:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836305.746524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511616 00000100:00100000:2.0:1788836305.746527:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511616 00000100:00100000:2.0:1788836305.746546:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788836305.746550:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746572:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3303:x1875730538511616:12345-0@lo:400:kworker.0 Request processed in 22us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746577:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788836305.746596:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538511488 00000100:00100000:2.0:1788836305.746599:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538511488 00000100:00100000:2.0:1788836305.746628:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788836305.746633:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538511488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836305.746656:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836305.746680:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538511488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836305.746685:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788836305.746738:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746746:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538511872:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746769:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538511616:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746780:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07b257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538511488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836305.746787:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538512128:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746801:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538512256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836305.746808:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538511744:0@lo:400:kworker.0 00000100:00080000:1.0:1788836305.747097:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836305.747101:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836305.747104:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836306.260446:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538512384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836306.260518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836306.260567:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512384 00000100:00100000:3.0:1788836306.260575:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512384 00000100:00100000:3.0:1788836306.260639:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836306.260648:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538512384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836306.260684:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836306.260732:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538512384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836306.260740:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836306.260784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538512384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788836306.705506:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788836307.459081:0:12901:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788836307.483966:0:12901:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788836307.484023:0:12901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.484055:0:12901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.484063:0:12901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.484070:0:12901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.484100:0:12901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788836307.484107:0:12901:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788836307.484133:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836307.484138:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788836307.484144:0:12901:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788836307.484171:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bd07d386000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788836307.484228:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538512512:0@lo:39:umount.0 00000100:00100000:0.0:1788836307.484326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836307.484463:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836307.484471:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.484479:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836307.484483:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.484492:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836307.484500:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836307.484505:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836307.484508:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788836307.484510:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788836307.484534:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.484540:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836307.484566:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.484574:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2800/0xcb5b7bc40b909337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90933e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.484594:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836307.484596:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836307.484598:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836307.484623:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512512 00000100:00100000:2.0:1788836307.484630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512512 00000100:00100000:2.0:1788836307.484673:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788836307.484682:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875730538512512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788836307.484709:0:5830:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9090c1 00000100:00080000:2.0:1788836307.484728:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9bd048715800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788836307.484789:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1875730538512512:12345-0@lo:39:umount.0 Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.484797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788836307.484808:0:5830:0:(genops.c:885:class_export_put()) final put ffff9bd048713800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788836307.484827:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836307.484835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538512640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.484868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836307.484900:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836307.484923:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07d386000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788836307.484932:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538512512:0@lo:39:umount.0 00000020:00000080:2.0:1788836307.484954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048713800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836307.484999:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd048715800 for lustre-MDT0000 00000100:00100000:2.0:1788836307.485012:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512640 00000100:00100000:2.0:1788836307.485016:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512640 00000100:00100000:2.0:1788836307.485050:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836307.485056:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd047943450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3304:x1875730538512640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.485066:0:6697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836307.485087:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031400/0xcb5b7bc40b90933e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909337 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.485101:0:6697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836307.485128:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd047943450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3304:x1875730538512640:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.485135:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836307.485194:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538512640:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788836307.485337:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836307.485339:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788836307.485373:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836307.486330:0:12901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486376:0:12901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486383:0:12901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486401:0:12901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486427:0:12901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836307.486434:0:12901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486441:0:12901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486446:0:12901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486451:0:12901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486463:0:12901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788836307.486468:0:12901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486474:0:12901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486480:0:12901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486486:0:12901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486506:0:12901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788836307.486511:0:12901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486516:0:12901:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486522:0:12901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486529:0:12901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836307.486536:0:12901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788836307.486539:0:12901:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788836307.486565:0:12901:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788836307.486569:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788836307.486573:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836307.486579:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1788836307.486585:0:12901:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd07afa6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836307.486591:0:12901:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd07a91f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836307.486599:0:12901:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9bcf45112800 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836307.486615:0:12901:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9bd04673cd28) has exports, disconnecting them 00000020:00080000:0.0:1788836307.486620:0:12901:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd07afa6000), last request at 1788836305 00000020:00000080:0.0:1788836307.486627:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909234 00000100:00080000:0.0:1788836307.486647:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836307.486700:0:12901:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07afa6000): rc 0 00000020:00000080:0.0:1788836307.486708:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07afa6000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788836307.486844:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788836307.486852:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486861:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836307.486865:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486874:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836307.486882:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836307.486887:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836307.486890:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788836307.486892:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788836307.486923:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486929:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836307.486952:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486964:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c200/0xcb5b7bc40b909345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b90934c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486977:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836307.486980:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486985:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836307.486988:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.486994:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836307.487000:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836307.487005:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836307.487007:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788836307.487009:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788836307.487021:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487027:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836307.487033:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487038:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3600/0xcb5b7bc40b90926c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909273 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487062:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836307.487066:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487071:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030e00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836307.487074:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487081:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836307.487086:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836307.487091:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788836307.487093:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788836307.487094:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788836307.487106:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487111:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836307.487127:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487134:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030e00/0xcb5b7bc40b90956e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909575 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487143:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836307.487145:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487157:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0dc00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836307.487159:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487165:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836307.487170:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836307.487175:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836307.487177:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788836307.487179:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788836307.487191:0:6696:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487198:0:6696:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836307.487203:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487209:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b909020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909027 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487220:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836307.487221:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836307.487223:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836307.487238:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538512768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.487298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836307.487369:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836307.487382:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538512896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.487404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836307.487439:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538513152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.487462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836307.487479:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836307.487484:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538513024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.487503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836307.487529:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512768 00000100:00100000:2.0:1788836307.487536:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512768 00000100:00100000:2.0:1788836307.487579:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538512896 00000100:00100000:2.0:1788836307.487582:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538512896 00000100:00100000:2.0:1788836307.487594:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538513152 00000100:00100000:2.0:1788836307.487597:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538513152 00000100:00100000:2.0:1788836307.487622:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538513024 00000100:00100000:2.0:1788836307.487625:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538513024 00000100:00100000:2.0:1788836307.487638:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836307.487645:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+21:3302:x1875730538512768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.487659:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836307.487676:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377800/0xcb5b7bc40b90934c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909345 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487691:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836307.487808:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+20:3302:x1875730538512768:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.487816:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836307.487831:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836307.487837:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+19:3302:x1875730538512896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.487844:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836307.487858:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377600/0xcb5b7bc40b909273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90926c expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487868:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836307.487891:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+18:3302:x1875730538512896:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.487898:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836307.487909:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836307.487914:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+17:3305:x1875730538513152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.487921:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836307.487929:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030400/0xcb5b7bc40b909027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909020 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.487938:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836307.487961:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+16:3305:x1875730538513152:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.487967:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836307.487979:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836307.487985:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+15:3305:x1875730538513024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.487990:0:8494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836307.487998:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060376000/0xcb5b7bc40b909575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90956e expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836307.488007:0:8494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836307.488025:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8e83d0f-78a2-4253-8765-c02f0116c7a1+14:3305:x1875730538513024:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836307.488031:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788836307.488059:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836307.488089:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538513024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.488097:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3305:1875730538513152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836307.488125:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836307.488142:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538512896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836307.488150:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3302:1875730538512768:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788836307.488267:0:12901:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd07a91f800), last request at 1788836305 00000020:00000080:0.0:1788836307.488275:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909169 00000100:00080000:0.0:1788836307.488285:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bd07a91d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836307.488302:0:12901:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07a91f800): rc 0 00000020:00000080:0.0:1788836307.488305:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07a91f800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788836307.488316:0:12901:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7ccc1893ae0 00000100:00080000:0.0:1788836307.488336:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788836307.488340:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788836307.488366:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788836307.488426:0:12901:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788836307.488442:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bd047ea3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788836307.488454:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788836307.488456:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788836307.488470:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788836307.488524:0:12901:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788836307.488532:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788836307.488558:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd04673cd28) has no exports 00000020:00000080:0.0:1788836307.489386:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07afa6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836307.489436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a91f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836307.489464:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07afa7000 for lustre-MDT0000 00000020:00000080:0.0:1788836307.489469:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07a91d800 for lustre-MDT0000 00000100:00100000:2.0:1788836307.490056:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538513280:0@lo:9:umount.0 00000100:00100000:2.0:1788836307.490142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836307.490216:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538513408:0@lo:9:umount.0 00000100:00100000:2.0:1788836307.490240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836307.490389:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836307.490461:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538513280 00000100:00100000:0.0:1788836307.490470:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538513280 00000100:00100000:3.0:1788836307.490594:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538513408 00000100:00100000:3.0:1788836307.490599:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538513408 00000100:00080000:1.0:1788836307.490673:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836307.490678:0:5825:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836307.490809:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788836307.490822:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875730538513280:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788836307.490859:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9091b6 00000100:00080000:0.0:1788836307.490870:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9bd05274f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788836307.490922:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788836307.491502:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf46d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1875730538513280:12345-0@lo:9:umount.0 Request processed in 681us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836307.491511:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788836307.491969:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836307.492160:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd047ea3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836307.492184:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836307.492187:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836307.492191:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538513280:0@lo:9:umount.0 00000100:00100000:3.0:1788836307.492306:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836307.492315:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875730538513408:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788836307.492357:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90929d 00000100:00080000:3.0:1788836307.492367:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836307.492395:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788836307.492792:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3301:x1875730538513408:12345-0@lo:9:umount.0 Request processed in 476us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836307.492818:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1788836307.492920:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836307.492943:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf448a7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788836307.492952:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788836307.492954:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788836307.492958:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538513408:0@lo:9:umount.0 00000020:00080000:0.0:1788836307.499176:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9bd04673cd28) has no exports 00000020:00000080:0.0:1788836307.537995:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90907b 00000020:00000080:0.0:1788836307.538011:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07a409800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788836307.538074:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788836307.538169:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836307.538180:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836307.538185:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9bd07d37b370) has no exports 00000020:00000080:3.0:1788836307.538589:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909074 00000020:00000080:3.0:1788836307.538595:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07d387800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836307.538699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a409800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788836307.538891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07d387800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836307.538952:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836307.538960:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788836307.538964:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd078fad000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788836307.538966:0:12901:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd078fad000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788836307.538973:0:12901:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788836307.729097:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836308.752648:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836309.439474:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836309.439484:0:7628:0:(genops.c:885:class_export_put()) final put ffff9bd07afa2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836309.439506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07afa2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788836309.439546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07afa1000 for lustre-OST0001 00000001:00100000:1.0:1788836309.462499:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000001:00080000:1.0:1788836309.462518:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788836309.462525:0:5851:0:(genops.c:885:class_export_put()) final put ffff9bcf45112800/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 00000020:00000080:3.0:1788836309.462919:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45112800/4c48ba00-7f2e-4f58-b5e4-15aa91896ef5 for lustre-MDT0000 00000020:00000080:3.0:1788836309.462973:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45111800 for lustre-MDT0000 00000001:00100000:1.0:1788836309.475611:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836309.475621:0:6708:0:(genops.c:885:class_export_put()) final put ffff9bcf45110800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836309.475689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45110800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788836309.475740:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd05274f800 for lustre-OST0000 00000020:01000000:3.0:1788836309.584601:0:12901:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bcf460f0060 - data ffff9bd05fc34798/ffff9bcf45cddc00 00000020:01000000:3.0:1788836309.585070:0:12901:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0454b0d80 - data ffff9bd0663fa1b0/ffff9bd0454a7800 00000001:00000004:3.0:1788836309.596679:0:12901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788836309.735197:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788836309.735205:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788836309.735491:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836309.735495:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788836309.739825:0:6831:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788836309.739831:0:6831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788836309.739840:0:6831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788836309.740619:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788836309.740625:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788836309.740646:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836309.740648:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788836309.741048:0:8089:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788836309.741052:0:8089:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788836309.741060:0:8089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:2.0:1788836309.783758:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788836309.795308:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909043 00000020:00000080:0.0:1788836309.795320:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b264000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836309.795436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b264000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788836309.798818:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909058 00000020:00000080:0.0:1788836309.798830:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b261800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788836309.798845:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788836309.798850:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836309.798858:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836309.798862:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9bd04673b370) has no exports 00000004:01000000:0.0:1788836309.799024:0:12901:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788836309.799032:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909296 00000020:00000080:0.0:1788836309.799036:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07a3a9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788836309.799040:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788836309.799043:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836309.799050:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788836309.799052:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9bd07b2b4d28) has no exports 00000020:00000080:0.0:1788836309.799059:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90928f 00000020:00000080:0.0:1788836309.799063:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bcf448a6000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788836309.799410:0:12901:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788836309.799414:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788836309.799419:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788836309.799424:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836309.799426:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836309.799453:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836309.799459:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836309.799464:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9091af 00000020:00000080:0.0:1788836309.799468:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd048717800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788836309.799472:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788836309.799475:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836309.799479:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788836309.799481:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9bd044d03370) has no exports 00000020:00000080:0.0:1788836309.799484:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9091a8 00000020:00000080:0.0:1788836309.799486:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd047ea2000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788836309.799795:0:12901:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788836309.799798:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788836309.799801:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788836309.799804:0:12901:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836309.799806:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836309.799829:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836309.799834:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836309.799855:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836309.799858:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836309.799883:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90905f 00000020:00000080:0.0:1788836309.799887:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b265800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788836309.799890:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788836309.799893:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836309.799896:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836309.799899:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9bd07b2b0000) has no exports 00000020:00000080:0.0:1788836309.799917:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836309.799919:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788836309.799928:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909066 00000020:00000080:0.0:1788836309.799932:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b267800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788836309.799938:0:12901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd0497a5800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788836309.799942:0:12901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd0497a5800 3 00000020:01000004:0.0:1788836309.799945:0:12901:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd0497a5800 from lustre-MDT0000 00000020:00000080:0.0:1788836309.799962:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836309.799965:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788836309.799968:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b262800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788836309.799971:0:12901:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b262800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788836309.799979:0:12901:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788836309.800034:0:12901:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788836309.800037:0:12901:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788836309.800040:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788836309.800043:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836309.800045:0:12901:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836309.800051:0:12901:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9bd0586ff000 e8e83d0f-78a2-4253-8765-c02f0116c7a1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836309.800057:0:12901:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9bd044d019b8) has exports, disconnecting them 00000020:00080000:0.0:1788836309.800061:0:12901:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bd0586ff000), last request at 1788836094 00000020:00000080:0.0:1788836309.800074:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909004 00000020:00010000:0.0:1788836309.800078:0:12901:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9bd0586ff000: total 7 00000100:00080000:0.0:1788836309.800081:0:12901:0:(import.c:65:import_set_state_nolock()) ffff9bd0586fa000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836309.800097:0:12901:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd0586ff000): rc 0 00000020:00080000:0.0:1788836309.800101:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9bd044d019b8) has no exports 00000020:00010000:2.0:1788836309.804131:0:6696:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9bd0586ff000: total 7 00010000:00010000:2.0:1788836309.804196:0:6696:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd0586ff000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788836309.804229:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2a00/0xcb5b7bc40b909306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b9092ff expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804251:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd060377a00/0xcb5b7bc40b909322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90931b expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804264:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd0413d2400/0xcb5b7bc40b909314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b90930d expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804275:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031800/0xcb5b7bc40b909330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909329 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804285:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0ce00/0xcb5b7bc40b90911c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909115 expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804298:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0c000/0xcb5b7bc40b90935a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909353 expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804309:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030000/0xcb5b7bc40b909559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909552 expref: 3 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804319:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040031a00/0xcb5b7bc40b909567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcb5b7bc40b909560 expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836309.804328:0:6696:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd0586ff000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788836309.804369:0:6696:0:(genops.c:885:class_export_put()) final put ffff9bd0586ff000/e8e83d0f-78a2-4253-8765-c02f0116c7a1 00010000:00010000:2.0:1788836309.804379:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836309.804381:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836309.804395:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836309.804442:0:5822:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bd047ec5400:5822] 0 exiting: rc = 1 00000100:00100000:2.0:1788836309.804547:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bd047ec4e00:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1788836309.804914:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bd047ec5c00:5824] 2 exiting: rc = 0 00000020:00000080:1.0:1788836309.804973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b261800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788836309.804980:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd052748800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836309.804982:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd052748800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788836309.804986:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836309.805136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a3a9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788836309.805142:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf448a6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836309.805148:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf448a7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788836309.805153:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd04862b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836309.805155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04862b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788836309.805161:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836309.805187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048717800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788836309.805192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047ea2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836309.805196:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd047ea3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788836309.805201:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd047ea0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836309.805203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047ea0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788836309.805206:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836309.805259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b265800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788836309.805263:0:36:0:(genops.c:885:class_export_put()) final put ffff9bd07b263800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788836309.805265:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b263800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788836309.805268:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788836309.805461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b267800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836309.805466:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0586ff000/e8e83d0f-78a2-4253-8765-c02f0116c7a1 for MGS 00000020:00000080:1.0:1788836309.805508:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd0586fa000 for MGS 00000100:00100000:0.0:1788836309.808987:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.808998:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809004:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809077:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809086:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809092:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809098:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809103:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809110:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809133:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809138:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809143:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809149:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809154:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809159:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809173:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809180:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809185:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809191:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809197:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809203:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809209:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809214:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809219:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809223:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809228:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809233:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809238:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809243:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809248:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809253:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809259:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809264:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809269:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809274:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809280:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809286:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809291:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809296:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809302:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809307:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809312:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809317:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809322:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.809336:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813030:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813059:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813067:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813073:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813079:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813084:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813089:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813094:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813099:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813104:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813111:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813118:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813123:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813130:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813135:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813140:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813146:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813151:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836309.813156:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788836309.813640:0:12901:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788836309.813644:0:12901:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788836309.821691:0:12901:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0466470c0 - data ffff9bd066365510/ffff9bcf450b2400 00000020:01000000:2.0:1788836309.821837:0:12901:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd050a4fde0 - data ffff9bd06636c870/ffff9bd047eabc00 00000020:00000080:2.0:1788836309.822307:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b908fe8 00000020:00000080:2.0:1788836309.822315:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd0497a0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836309.822502:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0497a0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788836309.822656:0:12901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd0497a5800 from MGS, refs=2 00000020:01000004:2.0:1788836309.822661:0:12901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd0497a5800 2 00000020:01000004:2.0:1788836309.822665:0:12901:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd0497a5800 from MGS 00000020:00000080:2.0:1788836309.822688:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836309.822695:0:12901:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788836309.822698:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd0486c6000/MGS 00000020:00000080:2.0:1788836309.822700:0:12901:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0486c6000/MGS for MGS 00000020:01000000:2.0:1788836309.822706:0:12901:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788836309.822761:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788836309.822765:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836309.822771:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836309.822778:0:12901:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bd07b260800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836309.822784:0:12901:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9bd07d37cd28) has exports, disconnecting them 00000020:00080000:2.0:1788836309.822788:0:12901:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bd07b260800), last request at 1788836095 00000020:00000080:2.0:1788836309.822792:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9090b3 00000020:00080000:2.0:1788836309.822801:0:12901:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07b260800): rc 0 00000020:00000080:2.0:1788836309.822805:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd07b260800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788836309.834554:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07b260800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788836309.992720:0:12901:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788836309.992729:0:12901:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836309.992733:0:12901:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836309.992741:0:12901:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836309.994623:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836309.994635:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788836309.994643:0:12901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd0497a5800 1 00000020:00000080:2.0:1788836309.994664:0:12901:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b908fda 00000020:00000080:2.0:1788836309.994672:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd0486c2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836309.994725:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07d386000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788836309.994734:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd07d383800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788836309.994737:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07d383800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788836309.994749:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788836309.996798:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788836309.996812:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836309.996820:0:12901:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836309.996826:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9bd044d00000) has no exports 00000020:00000080:0.0:1788836309.996935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0486c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836310.071003:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836310.071018:0:12901:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788836310.071024:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd0497a4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836310.071028:0:12901:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0497a4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788836310.071037:0:12901:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788836310.071178:0:12901:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd0497a6800 00000020:01000000:1.0:1788836310.071206:0:12901:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788836310.071211:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836310.071216:0:12901:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836310.071230:0:12901:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9bd0467399b8) has no exports 00000100:00100000:2.0:1788836310.071829:0:5829:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bd046768a00:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1788836310.071929:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bd05852b800:5831] 2 exiting: rc = 0 00000100:00100000:2.0:1788836310.071982:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bd05852ba00:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1788836310.072042:0:8192:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bd07983c000:8192] 3 exiting: rc = 0 00000100:00100000:1.0:1788836310.072703:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072713:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072719:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072725:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072731:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072736:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072743:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072750:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072755:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072760:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072780:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072786:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072792:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072798:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072804:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072809:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072815:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072821:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072828:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072834:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072840:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072845:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072852:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072858:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072863:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072868:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072874:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072879:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072885:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072891:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072897:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072903:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072908:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072914:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072933:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072940:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072947:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072953:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072958:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072964:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072970:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072975:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072981:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072986:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072993:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.072999:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073005:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073010:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073017:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073023:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073029:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073034:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073041:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073046:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073052:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073057:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073062:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073068:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073073:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073079:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073084:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073090:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073096:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.073103:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836310.080515:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bd05852be00:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1788836310.081422:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bd05852a200:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788836310.081738:0:11953:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9bd079779800:11953] 2 exiting: rc = 0 00000100:00100000:0.0:1788836310.081968:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.081976:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.081995:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082001:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082006:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082012:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082019:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082024:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082030:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082035:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082040:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082047:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082054:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082060:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082065:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082071:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082077:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082082:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082088:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082093:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082098:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082103:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082108:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082113:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082118:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082123:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082129:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082134:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082139:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082144:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082150:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082155:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082161:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082166:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082171:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082178:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082183:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082209:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082214:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082219:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082225:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082230:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082237:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082243:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082248:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082253:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082258:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082264:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082270:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082275:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082281:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082286:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082292:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082298:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082303:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082308:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082313:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082318:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082323:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082329:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082334:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082339:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082555:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.082560:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.083666:0:12002:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9bcf4490b400:12002] 2 exiting: rc = 0 00000100:00100000:0.0:1788836310.083878:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bd046699400:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1788836310.084008:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bd046699800:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788836310.084323:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084331:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084603:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084611:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084617:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084623:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084629:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084635:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084641:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084647:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084653:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084660:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084666:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084672:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084678:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084700:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084709:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084715:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084720:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084726:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084732:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084738:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084744:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084762:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084768:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084773:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084779:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084797:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084803:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084808:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084815:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084821:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084827:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084833:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084840:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084846:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084853:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084858:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084864:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084883:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084890:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084899:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084905:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084912:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084917:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084923:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084930:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084936:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084942:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084948:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084954:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084975:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084981:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084986:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.084992:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085003:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085009:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085017:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085031:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085042:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085053:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085059:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085070:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836310.085076:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099677:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bd046778200:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1788836310.099789:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bd046778800:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1788836310.099837:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099844:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099849:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099854:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099859:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099875:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099879:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099884:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099889:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099894:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099900:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099905:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099910:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099915:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099920:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099924:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099930:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099935:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099941:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099946:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099952:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099957:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099962:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099967:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099972:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099977:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099982:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099987:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099993:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.099998:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100004:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100009:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100014:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100020:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100026:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100032:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100036:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100042:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100047:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100053:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100065:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100070:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100076:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100081:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100086:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100092:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100098:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100103:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100108:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100112:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100117:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100122:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100127:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100131:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100137:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100141:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100147:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100151:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100156:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100161:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100166:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100171:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100175:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100180:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100856:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bd058506800:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788836310.100911:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bd058506200:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1788836310.100955:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100961:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100966:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100971:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100976:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100980:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100986:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100991:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.100997:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101011:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101016:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101021:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101026:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101030:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101035:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101040:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101045:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101054:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101060:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101066:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101072:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101078:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101084:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101089:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101095:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101100:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101105:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101110:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101115:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101120:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101125:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101130:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101135:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101141:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101146:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101152:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101157:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101163:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101169:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101174:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101179:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101185:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101190:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101195:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101208:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101214:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101219:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101224:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101229:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101235:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101240:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101245:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101250:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101255:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101261:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101266:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101272:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101277:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101282:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101288:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101294:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101299:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101304:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101309:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101886:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bd058507a00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788836310.101940:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bd058506600:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1788836310.101979:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101984:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101990:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101995:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.101999:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102004:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102010:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102014:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102019:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102023:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102028:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102033:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102038:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102049:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102054:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102058:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102064:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102069:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102074:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102078:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102083:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102088:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102093:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102097:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102102:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102106:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102110:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102114:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102119:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102123:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102128:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102132:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102137:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102142:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102147:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102152:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102157:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102162:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102167:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102172:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102177:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102181:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102186:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102191:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102196:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102200:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102205:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102209:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102219:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102224:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102229:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102233:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102238:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102243:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102248:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102253:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102257:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102262:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102267:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102271:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102275:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102280:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102285:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102289:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.102874:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bd043547e00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1788836310.103047:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bd043546200:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788836310.103199:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bd046698600:5844] 2 exiting: rc = 0 00000100:00100000:0.0:1788836310.103253:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103260:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103266:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103271:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103277:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103283:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103288:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103294:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103299:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103304:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103310:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103316:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103321:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103326:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103332:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103337:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103503:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103509:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103514:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103519:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103524:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103529:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103535:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103551:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103557:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103563:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103568:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103573:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103579:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103583:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103599:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103604:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103610:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103615:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103620:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103626:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103632:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103637:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103643:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103648:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103653:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103658:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103663:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103668:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103673:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103678:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103684:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103703:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103710:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103715:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103720:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103732:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103738:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103743:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103747:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103752:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103758:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103763:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103767:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103772:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103776:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103782:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103787:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836310.103792:0:12901:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788836310.108143:0:12901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836310.108157:0:12901:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788836310.108164:0:12901:0:(genops.c:885:class_export_put()) final put ffff9bd0486c3800/MDS_uuid 00000020:00000080:0.0:1788836310.108168:0:12901:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd0486c3800/MDS_uuid for MDS 00000020:01000000:0.0:1788836310.108174:0:12901:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788836310.108332:0:12901:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788836310.800468:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836310.864741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538513792:0@lo:400:kworker.0 00000400:00000100:1.0:1788836310.864798:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538513792 offset 0 length 224: 4 00000100:00100000:0.0:1788836310.865281:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538513664:0@lo:400:kworker.0 00000400:00000100:0.0:1788836310.865309:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538513664 offset 0 length 224: 4 00000100:00100000:0.0:1788836310.865329:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836310.865378:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538513536:0@lo:400:kworker.0 00000400:00000100:0.0:1788836310.865400:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538513536 offset 0 length 224: 4 00010000:00010000:3.0:1788836311.825722:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836312.857476:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788836313.351578:0:13055:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788836313.361909:0:13055:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788836313.363170:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836313.363187:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836313.363214:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836313.363220:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836313.363239:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788836313.363245:0:13055:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788836313.363281:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836313.363297:0:13055:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bcf45e67480 x1875730538513664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836326 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836313.363323:0:13055:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788836313.363330:0:13055:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788836313.363372:0:13055:0:(import.c:65:import_set_state_nolock()) ffff9bcf45113000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788836313.363457:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1875730538513664:0@lo:400:kworker.0 00010000:00010000:3.0:1788836313.363667:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836313.363677:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836313.363685:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d3a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836313.363695:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836313.363705:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836313.363712:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836313.363717:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788836313.363719:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538513920:0@lo:39:umount.0 10000000:01000000:3.0:1788836313.363720:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788836313.363722:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788836313.363747:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836313.363753:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836313.363778:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:2.0:1788836313.363781:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538513920 offset 0 length 224: 4 00010000:00010000:3.0:1788836313.363785:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3a00/0xcb5b7bc40b90931b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcb5b7bc40b909322 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836313.363798:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836313.363805:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836313.363807:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836313.363816:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836313.363827:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538514048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836313.363863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836313.368235:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538514048 00000100:00100000:2.0:1788836313.368249:0:8494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538514048 00000100:00100000:2.0:1788836313.368292:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836313.368301:0:8494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3304:x1875730538514048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788836313.368308:0:8494:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836313 with bad export cookie 14653441894517870596 00000100:00100000:2.0:1788836313.397422:0:8494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3304:x1875730538514048:12345-0@lo:103:ldlm_bl.0 Request processed in 29113us (33550us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788836313.397436:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788836313.397686:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836313.397691:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788836313.397695:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788836313.416247:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788836313.416252:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788836313.416261:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bcf45e64380 x1875730538513536/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788836326 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836313.416288:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bcf45e67800 x1875730538514048/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836329 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788836313.416299:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788836313.416302:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788836313.416303:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788836313.416307:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836313.416312:0:3304:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 147 00000100:00080000:1.0:1788836313.416321:0:3304:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd047f4b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836313.416372:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3303:1875730538513536:0@lo:400:kworker.0 00000100:00100000:0.0:1788836313.416439:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07af27100 x1875730538514176/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836313.416474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3304:1875730538514048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836313.416863:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538514176:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788836313.416969:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538514176 offset 0 length 520: 4 00010000:00010000:3.0:1788836313.872695:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836314.898482:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836315.933660:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836315.990050:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788836315.990061:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836315.990177:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836315.993088:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538514304:0@lo:400:kworker.0 00000400:00000100:1.0:1788836315.993148:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538514304 offset 0 length 224: 4 00010000:00010000:3.0:1788836316.944672:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836317.969105:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836318.032562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836318.032573:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836318.032692:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836318.032723:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538514432:0@lo:400:kworker.0 00000400:00000100:2.0:1788836318.032779:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538514432 offset 0 length 224: 4 00010000:00010000:3.0:1788836318.992623:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836320.017133:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836321.042577:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836322.065536:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836323.088674:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836323.152557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836323.152568:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836323.152707:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538514560:0@lo:400:kworker.0 00000400:00000100:0.0:1788836323.152762:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538514560 offset 0 length 224: 4 00000100:00100000:1.0:1788836323.665120:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836313/real 1788836313] req@ffff9bd07af27100 x1875730538514176/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836323.665152:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07af27100 x1875730538514176/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836323.665179:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836313/real 1788836313] req@ffff9bd07af24000 x1875730538513920/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836323.665193:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07af24000 x1875730538513920/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836323.665210:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836323.665290:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788836323.665295:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538514176:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788836323.665302:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf45113000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788836323.665318:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538513920:0@lo:39:umount.0 00000100:00080000:0.0:1788836323.665421:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836323.665426:0:13055:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788836323.665430:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836323.666315:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666330:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666338:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666388:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666428:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836323.666435:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666442:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666449:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666455:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836323.666475:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836323.666478:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836323.666485:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836323.666490:0:13055:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788836323.666492:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd0413d2c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836323.666504:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836323.666513:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836323.666520:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836323.666526:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788836323.666528:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788836323.666530:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:0.0:1788836323.666542:0:13055:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1788836323.666543:0:6696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:3.0:1788836323.666546:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788836323.666546:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788836323.666550:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788836323.666553:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d2c00/0xcb5b7bc40b909329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909330 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788836323.666556:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836323.666559:0:13055:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9bd07d378000) has no exports 00010000:00010000:3.0:1788836323.666565:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836323.666569:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836323.666581:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060377000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836323.666583:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836323.666590:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788836323.666590:0:13055:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9bd07d378000) has no exports 10000000:00010000:3.0:1788836323.666596:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836323.666601:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788836323.666603:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788836323.666605:0:6696:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788836323.666610:0:6696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:3.0:1788836323.666613:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836323.666620:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060377000/0xcb5b7bc40b909560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909567 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836323.666628:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836323.666630:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836323.666632:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836323.668210:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836323.669156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836323.669163:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788836323.669168:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836323.669177:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 366 00000100:00080000:2.0:1788836323.669183:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836323.669205:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd047f4b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836323.669237:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3dce00 x1875730538514688/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836323.669339:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538514688:0@lo:250:kworker.0 00000400:00000100:1.0:1788836323.669417:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730538514688 offset 0 length 520: 4 00000020:01000000:0.0:1788836323.669422:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd07a1d2a80 - data ffff9bcf44ca3af8/ffff9bd079845000 00000020:01000000:0.0:1788836323.669540:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bcf460f0480 - data ffff9bd05fc60d80/ffff9bcf452c1400 00100000:10000000:0.0:1788836323.681841:0:13055:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788836323.710821:0:13055:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909138 00000020:00000080:1.0:1788836323.710830:0:13055:0:(genops.c:885:class_export_put()) final put ffff9bd07a918800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788836323.710890:0:13055:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd078fee000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788836323.710894:0:13055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd078fee000 2 00000020:01000004:1.0:1788836323.710899:0:13055:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd078fee000 from lustre-OST0000 00000020:00000080:1.0:1788836323.710923:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836323.710933:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788836323.710936:0:13055:0:(genops.c:885:class_export_put()) final put ffff9bd07a91b800/lustre-OST0000_UUID 00000020:00000080:1.0:1788836323.710938:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a91b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788836323.710946:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788836323.710994:0:13055:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788836323.710998:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788836323.711002:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836323.711062:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788836323.711069:0:13055:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bcf45117800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788836323.711075:0:13055:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9bd07b2b3370) has exports, disconnecting them 00000020:00080000:1.0:1788836323.711080:0:13055:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bcf45117800), last request at 1788836108 00000020:00000080:1.0:1788836323.711084:0:13055:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909162 00000020:00080000:1.0:1788836323.711094:0:13055:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bcf45117800): rc 0 00000020:00000080:1.0:1788836323.711099:0:13055:0:(genops.c:885:class_export_put()) final put ffff9bcf45117800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788836323.711133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07a918800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788836323.712272:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf45117800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788836323.714479:0:13055:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788836323.714489:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836323.714503:0:13055:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836323.714510:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836323.714679:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836323.714688:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788836323.714697:0:13055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd078fee000 1 00000020:00000080:2.0:1788836323.714705:0:13055:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9090f2 00000020:00000080:2.0:1788836323.714715:0:13055:0:(genops.c:885:class_export_put()) final put ffff9bd048b6a800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788836323.714722:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788836323.714729:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836323.714735:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836323.714739:0:13055:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9bd07b2319b8) has no exports 00000020:00000080:3.0:1788836323.716869:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bcf45113000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788836323.716886:0:36:0:(genops.c:885:class_export_put()) final put ffff9bcf448a2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788836323.716890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bcf448a2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788836323.716904:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788836323.716954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048b6a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788836323.769181:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836323.769199:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788836323.769205:0:13055:0:(genops.c:885:class_export_put()) final put ffff9bd07d384800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788836323.769209:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07d384800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788836323.769219:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788836323.769331:0:13055:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd0526c6000 00000020:02000400:2.0:1788836323.770822:0:13055:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788836324.112536:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836325.136602:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836326.161945:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788836326.226566:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836310/real 1788836310] req@ffff9bcf45e65c00 x1875730538513792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836326 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.267602:0:3304:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9bcf45e65c00 x1875730538513792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836326 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836326.267622:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788836326.267627:0:3304:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788836326.275833:0:3304:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1788836326.275895:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538513792:0@lo:400:kworker.0 00000100:00080000:2.0:1788836326.276175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836326.276182:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836326.276194:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836326.276198:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788836326.276202:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836326.276210:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 176 00000100:00080000:2.0:1788836326.276218:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd07afa0000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836326.276254:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3dd180 x1875730538514816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836326.276473:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538514816:0@lo:38:kworker.0 00000400:00000100:0.0:1788836326.276535:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730538514816 offset 0 length 520: 4 00000020:01000004:3.0:1788836326.374242:0:13207:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788836326.383523:0:13207:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788836326.383601:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.383617:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.383624:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.383630:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.383651:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836326.383656:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788836326.383676:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836326.383686:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07af25500 x1875730538514304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836331 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383707:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07acb3480 x1875730538514432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383736:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a3dea00 x1875730538514560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383750:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a3dd180 x1875730538514816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836336 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383759:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788836326.383789:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1875730538514560:0@lo:400:kworker.0 00000100:00080000:3.0:1788836326.383820:0:13207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836326.383826:0:13207:0:(import.c:65:import_set_state_nolock()) ffff9bd07afa0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788836326.383831:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836326.383835:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07af25500 x1875730538514304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836331 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383843:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07acb3480 x1875730538514432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836334 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383851:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a3dd180 x1875730538514816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836336 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836326.383857:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836326.383860:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1788836326.383915:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788836326.384031:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538514432:0@lo:400:kworker.0 00010000:00010000:2.0:1788836326.384043:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836326.384051:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836326.384059:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836326.384063:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836326.384072:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836326.384077:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538514816:0@lo:38:kworker.0 10000000:00010000:2.0:1788836326.384084:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836326.384090:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836326.384093:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788836326.384095:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788836326.384108:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:2.0:1788836326.384111:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836326.384117:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0d600/0xcb5b7bc40b9092ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909306 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836326.384134:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836326.384136:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836326.384137:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836326.385339:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386207:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386215:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386222:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386325:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836326.386335:0:13207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386356:0:13207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386362:0:13207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836326.386367:0:13207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386519:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836326.386526:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386533:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd060376600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836326.386537:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386545:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836326.386552:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836326.386557:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836326.386560:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788836326.386570:0:6696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:1.0:1788836326.386574:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386590:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd060376600/0xcb5b7bc40b90930d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909314 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386600:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836326.386603:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386609:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1788836326.386612:0:6696:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386618:0:6696:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836326.386624:0:6696:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836326.386628:0:6696:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788836326.386630:0:6696:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788836326.386635:0:6696:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:1.0:1788836326.386637:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836326.386644:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836326.386646:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836326.386648:0:6696:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836326.386709:0:13207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836326.386713:0:13207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999400/0xcb5b7bc40b909552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b909559 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836326.386725:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788836326.386730:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788836326.386732:0:13207:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788836326.386754:0:13207:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788836326.386758:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788836326.386763:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836326.386768:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788836326.386772:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9bd07b234d28) has no exports 00000020:00080000:3.0:1788836326.386795:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9bd07b234d28) has no exports 00000020:01000000:3.0:1788836326.392274:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd07a1d26c0 - data ffff9bd07ff086c0/ffff9bd079846c00 00010000:00010000:1.0:1788836326.392432:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788836326.392711:0:13207:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd0517bf360 - data ffff9bd07fe58288/ffff9bcf44a46400 00100000:10000000:3.0:1788836326.405067:0:13207:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788836326.435115:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b909203 00000020:00000080:2.0:1788836326.435129:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd07985e800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788836326.435141:0:13207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd079eb5000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788836326.435145:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd079eb5000 2 00000020:01000004:2.0:1788836326.435148:0:13207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd079eb5000 from lustre-OST0001 00000020:00000080:1.0:1788836326.435152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07985e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788836326.435175:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836326.435186:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788836326.435188:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd079eb2000/lustre-OST0001_UUID 00000020:00000080:2.0:1788836326.435191:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079eb2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788836326.435198:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788836326.435401:0:13207:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e8e83d0f-78a2-4253-8765-c02f0116c7a1->MGS 00010000:00010000:2.0:1788836326.435419:0:13207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836326.435431:0:13207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836326.435437:0:13207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788836326.435440:0:13207:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788836326.435443:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788836326.435456:0:13207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:2.0:1788836326.435459:0:13207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd040030600/0xcb5b7bc40b909115 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90911c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836326.435472:0:13207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836326.435503:0:13207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836326.435509:0:13207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836326.435511:0:13207:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788836326.435513:0:13207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788836326.435521:0:13207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd047f4b800 00010000:00010000:2.0:1788836326.435524:0:13207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd0413d3400/0xcb5b7bc40b909353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcb5b7bc40b90935a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836326.435540:0:13207:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788836326.435544:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788836326.435546:0:13207:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788836326.435547:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788836326.435551:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788836326.435560:0:13207:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd07a3dce00 x1875730538514688/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788836338 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788836326.435571:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788836326.435573:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1788836326.435687:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8e83d0f-78a2-4253-8765-c02f0116c7a1:3301:1875730538514688:0@lo:250:kworker.0 10000000:01000000:2.0:1788836326.435733:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788836326.435739:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b908ff6 00000020:00000080:2.0:1788836326.435743:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd047f4a000/e8e83d0f-78a2-4253-8765-c02f0116c7a1 00000020:01000000:2.0:1788836326.435757:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:2.0:1788836326.435761:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836326.435765:0:13207:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788836326.435777:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9bd046738000) has no exports 10000000:01000000:0.0:1788836326.436034:0:5826:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788836326.436148:0:13207:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:2.0:1788836326.436151:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788836326.436154:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788836326.436156:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788836326.436163:0:13207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788836326.436193:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836326.436198:0:13207:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid e8e83d0f-78a2-4253-8765-c02f0116c7a1) 00000020:01000000:2.0:1788836326.436203:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788836326.436206:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836326.436209:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836326.436214:0:13207:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bd07afa5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836326.436219:0:13207:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9bd07d3799b8) has exports, disconnecting them 00000020:00080000:2.0:1788836326.436223:0:13207:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bd07afa5000), last request at 1788836123 00000020:00000080:2.0:1788836326.436227:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b90922d 00000020:00000080:1.0:1788836326.436277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f4a000/e8e83d0f-78a2-4253-8765-c02f0116c7a1 for MGC192.168.203.152@tcp 00000020:00000080:1.0:1788836326.436296:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd047f4b800 for MGC192.168.203.152@tcp 00000020:00080000:2.0:1788836326.436300:0:13207:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd07afa5000): rc 0 00000020:00000080:1.0:1788836326.436304:0:8:0:(genops.c:885:class_export_put()) final put ffff9bd047f4c800/e8e83d0f-78a2-4253-8765-c02f0116c7a1 00000020:00000080:2.0:1788836326.436306:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd07afa5000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788836326.436308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd047f4c800/e8e83d0f-78a2-4253-8765-c02f0116c7a1 for MGC192.168.203.152@tcp 00000020:01000000:1.0:1788836326.436314:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (e8e83d0f-78a2-4253-8765-c02f0116c7a1) 00000020:00000080:1.0:1788836326.436876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07afa5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788836326.438430:0:13207:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788836326.438437:0:13207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836326.438440:0:13207:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836326.438446:0:13207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836326.438549:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9bd07afa0000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788836326.441421:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788836326.441561:0:6696:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788836326.441903:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788836326.442130:0:5812:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bd045042a00:5812] 0 exiting: rc = 1 00000100:00100000:1.0:1788836326.442185:0:11155:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bcf448e2a00:11155] 2 exiting: rc = 0 00000100:00100000:0.0:1788836326.442409:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bd0517eca00:5813] 1 exiting: rc = 0 00000100:00100000:1.0:1788836326.442718:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.442980:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bd04876a600:5815] 1 exiting: rc = 0 00000100:00100000:0.0:1788836326.443004:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bd045c50200:5816] 2 exiting: rc = 0 00000100:00100000:2.0:1788836326.444135:0:6697:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bcf44ac5000:6697] 3 exiting: rc = 0 00000100:00100000:3.0:1788836326.444140:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bd04876ac00:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1788836326.444931:0:8494:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9bd0505b2c00:8494] 4 exiting: rc = 0 00000100:00100000:1.0:1788836326.445248:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445257:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445268:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445274:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445279:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445284:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445289:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445296:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445300:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445305:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445316:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445322:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445327:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445365:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445374:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445381:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445388:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445393:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445409:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445415:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445420:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445425:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445430:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445436:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445441:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445446:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445450:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445455:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445460:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445465:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445470:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445485:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445491:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445496:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445501:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445506:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445511:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445516:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445521:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445526:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445531:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445536:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445541:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445546:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445551:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445555:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445560:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445565:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445571:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445576:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445581:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445587:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445591:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445603:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445608:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445613:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445618:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445623:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445628:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445634:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445638:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445643:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445648:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.445654:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788836326.448649:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836326.448662:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788836326.448668:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd07afa3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788836326.448672:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd07afa3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788836326.448678:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788836326.448733:0:13207:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd079eb5000 1 00000020:00000080:1.0:1788836326.448738:0:13207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcb5b7bc40b9091d2 00000020:00000080:1.0:1788836326.448745:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd04790c800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788836326.448759:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788836326.448764:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836326.448768:0:13207:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788836326.448772:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9bd07b233370) has no exports 00000020:00000080:0.0:1788836326.448833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd04790c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788836326.477174:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836326.477189:0:13207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788836326.477196:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd079eb2800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788836326.477201:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd079eb2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788836326.477215:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788836326.478782:0:13207:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd079eb0000 00000020:01000000:1.0:1788836326.478808:0:13207:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788836326.478813:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836326.478818:0:13207:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836326.478822:0:13207:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9bd07b2b19b8) has no exports 00000020:00000080:1.0:1788836326.478843:0:13207:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836326.478850:0:13207:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788836326.478853:0:13207:0:(genops.c:885:class_export_put()) final put ffff9bd048b68800/OSS_uuid 00000020:00000080:1.0:1788836326.478856:0:13207:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd048b68800/OSS_uuid for OSS 00000020:01000000:1.0:1788836326.478867:0:13207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788836326.480162:0:5825:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788836326.480382:0:12003:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bd06138ac00:12003] 3 exiting: rc = 0 00000100:00100000:1.0:1788836326.480519:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bd04667b600:6681] 1 exiting: rc = 0 00000100:00100000:3.0:1788836326.480716:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bd04667bc00:6680] 0 exiting: rc = 1 00000100:00100000:3.0:1788836326.480969:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bd079d98600:6683] 2 exiting: rc = 0 00000100:00100000:1.0:1788836326.481045:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481054:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481061:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481070:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481079:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481086:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481093:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481099:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481110:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481116:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481121:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481147:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481152:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481157:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481161:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481167:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481172:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481178:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481186:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481193:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481200:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481209:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481215:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481227:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481244:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481250:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481255:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481260:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481265:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481269:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481275:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481280:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481284:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481289:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481293:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481307:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481313:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481318:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481323:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481327:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481333:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481337:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481376:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481383:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481388:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481393:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481409:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481415:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481420:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481425:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481430:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481436:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481441:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481445:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481450:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481455:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481460:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481465:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481471:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481487:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481494:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481499:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481504:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.481508:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836326.484975:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bd07a865c00:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1788836326.491620:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bd07a86cc00:6685] 1 exiting: rc = 0 00000100:00100000:0.0:1788836326.491761:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491768:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491773:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491777:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491783:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491788:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491793:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491797:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491802:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491807:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491812:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491817:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491823:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491828:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491832:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491838:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491843:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491849:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491855:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491862:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491870:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491880:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491885:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491896:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491902:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491907:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491912:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491917:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491922:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491928:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.491963:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492028:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492037:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492041:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492046:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492063:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492068:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492072:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492078:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492082:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492087:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492092:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492097:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492102:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492107:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492112:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492117:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492121:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492127:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492131:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492137:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492144:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492152:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492161:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492168:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492173:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492178:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492184:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492189:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492195:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492200:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492205:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492210:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836326.492215:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836326.495050:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bd048b72400:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1788836326.495313:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bd048b72e00:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1788836326.495740:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bd07a864600:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788836326.495862:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.495870:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.495876:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.495883:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496142:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496151:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496157:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496165:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496171:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496177:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496185:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496191:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496197:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496202:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496208:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496214:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496220:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496226:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496332:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496503:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496511:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496517:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496523:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496529:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496534:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496539:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496545:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496568:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496575:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496582:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496588:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496593:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496598:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496603:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496609:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496615:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496619:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496625:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496631:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496647:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496652:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496657:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496664:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496669:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496675:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496680:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496685:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496691:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496696:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496701:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496706:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496711:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496717:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496722:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496728:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496742:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496764:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496772:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496777:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496783:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496789:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496794:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496800:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.496805:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836326.506721:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bd07b192400:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1788836326.509128:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bd07ef90c00:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788836326.512900:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512910:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512915:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512920:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512925:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512930:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512936:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512941:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512946:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512951:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512982:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512988:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512994:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.512999:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513004:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513009:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513014:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513019:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513024:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513029:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513034:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513039:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513045:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513050:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513055:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513059:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513064:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513068:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513072:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513077:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513082:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513086:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513091:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513096:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513100:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513105:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513110:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513114:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513121:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513126:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513131:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513135:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513140:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513145:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513149:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513159:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513164:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513169:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513174:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513179:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513184:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513188:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513193:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513198:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513203:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513208:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513213:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513217:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513222:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513227:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513238:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513243:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513248:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.513253:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836326.514154:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bd07a86d400:6691] 0 exiting: rc = 1 00000100:00100000:3.0:1788836326.514247:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bd07a86ca00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1788836326.516082:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516102:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516108:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516140:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516146:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516152:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516158:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516166:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516172:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516179:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516185:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516191:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516197:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516202:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516208:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516225:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516248:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516254:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516259:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516265:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516271:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516276:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516282:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516287:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516294:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516299:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516304:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516325:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516332:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516337:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516356:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516365:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516373:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516378:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516384:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516390:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516404:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516410:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516416:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516437:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516445:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516451:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516457:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516462:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516467:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516472:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516487:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516494:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516499:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516505:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516511:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516539:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516546:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516551:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516556:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516562:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516569:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516575:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516581:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516587:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516593:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516609:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516616:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836326.516622:0:13207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788836326.528936:0:13207:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788836342.332503:0:13824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788836350.567942:0:14285:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788836350.567947:0:14285:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788836350.568128:0:14285:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bcf45ede000 00000020:01000004:1.0:1788836350.568143:0:14285:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788836350.568151:0:14285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788836350.568162:0:14285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bd07b233370) 00000020:00000080:1.0:1788836350.568175:0:14285:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788836350.586172:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788836350.588905:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788836350.589430:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788836350.589526:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788836350.589615:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788836350.589995:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788836350.590134:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788836350.590233:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788836350.590372:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788836350.590616:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788836350.592251:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 276: rc = 0 00100000:10000000:2.0:1788836350.592526:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 276: rc = 0 00100000:10000000:2.0:1788836350.593493:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.593849:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.594303:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:2.0:1788836350.594676:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:2.0:1788836350.595154:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:2.0:1788836350.595449:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.595924:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.596243:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:2.0:1788836350.596849:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.597178:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:2.0:1788836350.597481:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:2.0:1788836350.597758:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 592: rc = 0 00100000:10000000:2.0:1788836350.598164:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 615: rc = 0 00100000:10000000:2.0:1788836350.598451:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 615: rc = 0 00100000:10000000:2.0:1788836350.598687:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 615: rc = 0 00100000:10000000:2.0:1788836350.598926:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 615: rc = 0 00100000:10000000:2.0:1788836350.599157:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 615: rc = 0 00100000:10000000:2.0:1788836350.599455:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 615: rc = 0 00100000:10000000:2.0:1788836350.599683:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 615: rc = 0 00100000:10000000:2.0:1788836350.599915:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 615: rc = 0 00100000:10000000:2.0:1788836350.600154:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 615: rc = 0 00100000:10000000:3.0:1788836350.601187:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 615: rc = 0 00100000:10000000:3.0:1788836350.601490:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 615: rc = 0 00100000:10000000:3.0:1788836350.601756:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 615: rc = 0 00100000:10000000:3.0:1788836350.602190:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 615: rc = 0 00100000:10000000:3.0:1788836350.602477:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 615: rc = 0 00100000:10000000:3.0:1788836350.603964:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 615: rc = 0 00100000:10000000:3.0:1788836350.604221:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 615: rc = 0 00100000:10000000:3.0:1788836350.604498:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 615: rc = 0 00100000:10000000:3.0:1788836350.604748:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 615: rc = 0 00100000:10000000:3.0:1788836350.604990:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 615: rc = 0 00100000:10000000:3.0:1788836350.605218:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 615: rc = 0 00100000:10000000:3.0:1788836350.607858:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 615: rc = 0 00100000:10000000:3.0:1788836350.609540:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 615: rc = 0 00100000:10000000:3.0:1788836350.610908:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 615: rc = 0 00100000:10000000:3.0:1788836350.612255:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 615: rc = 0 00100000:10000000:3.0:1788836350.612875:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 615: rc = 0 00100000:10000000:3.0:1788836350.613462:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 615: rc = 0 00100000:10000000:3.0:1788836350.613912:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 615: rc = 0 00100000:10000000:3.0:1788836350.614223:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 615: rc = 0 00100000:10000000:3.0:1788836350.614569:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 615: rc = 0 00100000:10000000:3.0:1788836350.615008:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 615: rc = 0 00100000:10000000:3.0:1788836350.615603:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 615: rc = 0 00100000:10000000:3.0:1788836350.616303:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 615: rc = 0 00100000:10000000:3.0:1788836350.617333:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 643: rc = 0 00100000:10000000:3.0:1788836350.618263:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788836350.618522:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:3.0:1788836350.618921:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788836350.618995:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:3.0:1788836350.619425:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788836350.619502:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00100000:10000000:3.0:1788836350.620035:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788836350.620232:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 277: rc = 0 00100000:10000000:3.0:1788836350.620523:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788836350.620591:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 277: rc = 0 00100000:10000000:3.0:1788836350.620986:0:14285:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788836350.621159:0:14285:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 277: rc = 0 00000020:00000080:3.0:1788836350.621506:0:14285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788836350.621513:0:14285:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836350.621523:0:14285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a2f7 00000020:01000004:3.0:1788836350.621530:0:14285:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788836350.621535:0:14285:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788836350.621540:0:14285:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bcf45ede000 from MGS 00000020:01000004:3.0:1788836350.621543:0:14285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788836350.621552:0:14285:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bd07b2b3370) 00000020:00000080:3.0:1788836350.621561:0:14285:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788836350.621607:0:14285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf45ede000 from MGS, refs=2 00080000:01000000:3.0:1788836350.621617:0:14285:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836350.621804:0:14285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a305 00000100:00100000:3.0:1788836350.621898:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788836350.622031:0:14285:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788836350.622038:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788836350.623995:0:14285:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788836350.624006:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788836350.624960:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.625285:0:14285:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788836350.625290:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788836350.633964:0:14285:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788836350.633980:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788836350.635572:0:14285:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788836350.635582:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788836350.638884:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836350.638890:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836350.638892:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836350.639462:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836350.639465:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836350.639467:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836350.645258:0:14285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788836350.646750:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788836350.694062:0:14285:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788836350.694079:0:14285:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788836350.694082:0:14285:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788836350.704899:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788836350.705121:0:14285:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788836350.705238:0:14285:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788836350.705798:0:14285:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788836350.706096:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.706266:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788836350.706272:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788836350.711301:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788836350.711338:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788836350.711935:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788836350.711943:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788836350.712761:0:14285:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788836350.712782:0:14285:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:3.0:1788836350.712784:0:14285:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788836350.712814:0:14285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:3.0:1788836350.712826:0:14285:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff9bd07b2b19b8) 00000020:00000080:3.0:1788836350.712840:0:14285:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788836350.712908:0:14285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07ae76800@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836350.713055:0:14285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:3.0:1788836350.713061:0:14285:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788836350.713200:0:14299:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788836350.718855:0:14300:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788836350.719227:0:14285:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid e8cc5c45-b703-4cf0-83fd-6722cde04691) 00000020:00000080:1.0:1788836350.719250:0:14285:0:(genops.c:1385:class_connect()) connect: client e8cc5c45-b703-4cf0-83fd-6722cde04691, cookie 0xcb5b7bc40b90a313 00000100:00080000:1.0:1788836350.719261:0:14285:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836350.719268:0:14285:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9bd07ae76800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788836350.719322:0:14285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07acb0700 x1875730538514944/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836350.719585:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538514944:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788836350.719651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788836350.719738:0:14285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e8cc5c45-b703-4cf0-83fd-6722cde04691->MGS 00000020:01000004:1.0:1788836350.719761:0:14285:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788836350.719766:0:14285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788836350.719779:0:14285:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bd07b230000) 00000020:00000080:1.0:1788836350.719792:0:14285:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788836350.726233:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538514944 00000100:00100000:3.0:1788836350.726246:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538514944 00000100:00100000:3.0:1788836350.726287:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836350.726296:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1875730538514944:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788836350.727056:0:14296:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e8cc5c45-b703-4cf0-83fd-6722cde04691@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1788836350.727088:0:14296:0:(genops.c:1385:class_connect()) connect: client e8cc5c45-b703-4cf0-83fd-6722cde04691, cookie 0xcb5b7bc40b90a321 00000100:00080000:3.0:1788836350.730329:0:14296:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836350.730445:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:3301:x1875730538514944:12345-0@lo:250:mount.lustre.0 Request processed in 4147us (10791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836350.730456:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836350.730880:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788836350.730891:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1788836350.730897:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788836350.730902:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788836350.730905:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07ae76800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788836350.730909:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788836350.730918:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788836350.730923:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e8cc5c45-b703-4cf0-83fd-6722cde04691:3301:1875730538514944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788836350.742310:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836350.742966:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788836350.742971:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788836350.746278:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836350.746290:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788836350.747827:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836350.747837:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788836350.748815:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836350.749175:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788836350.749182:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788836350.750651:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788836350.750664:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788836350.781439:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.781818:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788836350.781825:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788836350.783111:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788836350.783121:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788836350.783817:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.783977:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788836350.783983:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788836350.784542:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788836350.784549:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788836350.785635:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.785968:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788836350.785973:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788836350.786532:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788836350.786539:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788836350.787961:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.788129:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788836350.788135:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788836350.788947:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788836350.788955:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788836350.839802:0:14285:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836350.840025:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836350.840031:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788836350.854338:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836350.854386:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788836350.857211:0:14285:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836350.857223:0:14285:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788836350.858611:0:14285:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788836350.858637:0:14285:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788836350.858650:0:14285:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788836350.858786:0:14285:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836350.858826:0:14285:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788836350.858831:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836350.858832:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836350.858834:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836350.858835:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836350.858836:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836350.858838:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836350.858839:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836350.858841:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836350.858842:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836350.858843:0:14285:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836350.858846:0:14285:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788836350.858848:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836350.858850:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836350.858851:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836350.858852:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836350.858853:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836350.858854:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836350.858855:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836350.858856:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836350.858857:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836350.858858:0:14285:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836350.858884:0:14285:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788836350.858904:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836350.858971:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836350.859021:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047f11600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836350.859158:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515072 00000100:00100000:0.0:1788836350.859166:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515072 00000100:00100000:0.0:1788836350.859216:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836350.859226:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:14285:x1875730538515072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836350.859273:0:14298:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836350.859276:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788836350.859280:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788836350.860876:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788836350.861678:0:14298:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788836350.863987:0:14320:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788836350.863995:0:14320:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788836350.863997:0:14320:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788836350.864030:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788836350.864901:0:14298:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836350.864914:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788836350.874239:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:14285:x1875730538515072:12345-0@lo:253:mount.lustre.0 Request processed in 15007us (15259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836350.874256:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836350.874400:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836350.874416:0:14285:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788836350.874419:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836350.874421:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836350.874422:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836350.874423:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836350.874424:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836350.874425:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836350.874439:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836350.874441:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836350.874442:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836350.874443:0:14285:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836350.874460:0:14285:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bcf45ede000 from lustre-MDT0000 10000000:01000000:3.0:1788836350.874485:0:14285:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788836350.874488:0:14285:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788836350.874492:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd07b2b19b8 10000000:01000000:3.0:1788836350.874498:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836350.874506:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd07b2b19b8 from 1 10000000:01000000:3.0:1788836350.874509:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788836350.874548:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.874558:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.874568:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836350.874589:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836350.874643:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836350.874678:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836350.874881:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515200 00000100:00100000:1.0:1788836350.874888:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515200 00000100:00100000:1.0:1788836350.874927:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836350.874936:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:14285:x1875730538515200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836350.874960:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836350.874975:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90a32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a328 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836350.874999:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90a32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a328 expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836350.875009:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978aa00/0xcb5b7bc40b90a32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a328 expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836350.875018:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978aa00, rc 0) 00000100:00100000:1.0:1788836350.875066:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+6:14285:x1875730538515200:12345-0@lo:101:mount.lustre.0 Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836350.875081:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836350.875377:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836350.875402:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.875411:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836350.875473:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836350.875504:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836350.875531:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836350.876243:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515328 00000100:00100000:1.0:1788836350.876251:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515328 00000100:00100000:1.0:1788836350.876285:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836350.876292:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+6:14285:x1875730538515328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836350.876563:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+6:14285:x1875730538515328:12345-0@lo:501:mount.lustre.0 Request processed in 271us (1057us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836350.876571:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836350.876642:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788836350.876688:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788836350.876708:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.876717:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836350.876725:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bcf45ede000 10000000:01000000:2.0:1788836350.876730:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788836350.876734:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bcf45ede000 10000000:01000000:2.0:1788836350.876736:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788836350.876739:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bcf45ede000 from 1 10000000:01000000:2.0:1788836350.876741:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788836350.876764:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.876772:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.876792:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836350.876809:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836350.876838:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836350.876867:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836350.877374:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515456 00000100:00100000:3.0:1788836350.877380:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515456 00000100:00100000:3.0:1788836350.877415:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836350.877422:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+6:14285:x1875730538515456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836350.877432:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836350.877447:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c400/0xcb5b7bc40b90a33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a336 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.877467:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c400/0xcb5b7bc40b90a33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a336 expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.877485:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c400/0xcb5b7bc40b90a33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a336 expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.877494:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c400, rc 0) 00000100:00100000:3.0:1788836350.877538:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+7:14285:x1875730538515456:12345-0@lo:101:mount.lustre.0 Request processed in 117us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836350.877544:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836350.877728:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836350.877741:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.877750:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836350.877763:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788836350.877776:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.877784:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999c00/0xcb5b7bc40b90a336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a33d expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836350.877792:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788836350.877796:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836350.877801:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bcf45ede000 10000000:01000000:2.0:1788836350.877804:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788836350.877806:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788836350.877809:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788836350.877824:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.877836:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.877844:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836350.877858:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836350.877884:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836350.877912:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836350.877920:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515584 00000100:00100000:3.0:1788836350.877925:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515584 00000100:00100000:3.0:1788836350.877945:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836350.877952:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+7:14285:x1875730538515584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836350.877959:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836350.877971:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90a34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a344 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.877985:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90a34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a344 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.877993:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d200/0xcb5b7bc40b90a34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a344 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836350.878000:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d200, rc 0) 00000100:00100000:3.0:1788836350.878035:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+8:14285:x1875730538515584:12345-0@lo:101:mount.lustre.0 Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836350.878041:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836350.878140:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836350.878152:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836350.878159:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836350.878198:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836350.878294:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836350.878372:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836350.883072:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515712 00000100:00100000:1.0:1788836350.883086:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515712 00000100:00100000:1.0:1788836350.883466:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836350.883479:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+8:14285:x1875730538515712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836350.883923:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14285:x1875730538515712:12345-0@lo:501:mount.lustre.0 Request processed in 447us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836350.884004:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836350.884061:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836350.884114:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836350.884167:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836350.884220:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515840 00000100:00100000:0.0:1788836350.884225:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515840 00000100:00100000:1.0:1788836350.890491:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836350.890821:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836350.890838:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14285:x1875730538515840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836350.891246:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14285:x1875730538515840:12345-0@lo:503:mount.lustre.0 Request processed in 413us (7130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836350.891252:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836350.891519:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538515840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836350.897554:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14321:1875730538515968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836350.897645:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836350.897688:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07af94f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836350.897783:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538515968 00000100:00100000:1.0:1788836350.897790:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538515968 00000100:00100000:1.0:1788836350.897849:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836350.897858:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14321:x1875730538515968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836350.898176:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14321:x1875730538515968:12345-0@lo:502:llog_process_th.0 Request processed in 318us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836350.898184:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836350.898230:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14321:1875730538515968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788836350.898262:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836350.898273:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836350.898276:0:14321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836350.898281:0:14321:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788836350.898284:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836350.898309:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bd07b2b0000) 00000020:00000080:3.0:1788836350.898336:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788836350.898370:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788836350.898438:0:14321:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788836350.898446:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a359 00000020:00000080:3.0:1788836350.898680:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788836350.898684:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836350.898688:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836350.898690:0:14321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788836350.898693:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836350.898696:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836350.898698:0:14321:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788836350.898701:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836350.898709:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bd07b2b4d28) 00000020:00000080:3.0:1788836350.898719:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788836350.898722:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788836350.898724:0:14321:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788836350.898727:0:14321:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788836350.898733:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836350.898774:0:14321:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf45ede000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788836350.898795:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bd07bbd4d28) 00000020:00000080:3.0:1788836350.898804:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788836350.898847:0:14321:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788836350.898852:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90a36e 00000020:00000080:3.0:1788836350.898932:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788836350.898938:0:14321:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788836350.898941:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcb5b7bc40b90a375 00080000:01000000:3.0:1788836350.898946:0:14321:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788836350.898948:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a37c 00010000:00010000:3.0:1788836351.027070:0:14321:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788836351.027957:0:14321:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788836351.028154:0:14321:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788836351.030418:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bd07bbd0000) 00000020:00000080:3.0:1788836351.030442:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788836351.030536:0:14321:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788836351.030546:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a38a 00000020:00000080:3.0:1788836351.031505:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788836351.037617:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcb5b7bc40b90a391 00000020:00000080:3.0:1788836351.038503:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788836351.038513:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836351.038519:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836351.038521:0:14321:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788836351.038524:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836351.038529:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836351.038531:0:14321:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788836351.038534:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788836351.038565:0:14321:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788836351.038575:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836351.038578:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836351.038579:0:14321:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788836351.038581:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788836351.038592:0:14321:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788836351.038593:0:14321:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836351.038595:0:14321:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836351.038597:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788836351.038599:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836351.038601:0:14321:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788836351.038603:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836351.038606:0:14321:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788836351.038609:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836351.038610:0:14321:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788836351.038624:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836351.038629:0:14321:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788836351.038651:0:14321:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788836351.038653:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836351.038667:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd07bbd19b8) 00000020:00000080:3.0:1788836351.038680:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788836351.038684:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836351.038735:0:14321:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788836351.038739:0:14321:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788836351.038745:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a39f 00010000:00080000:3.0:1788836351.038773:0:14321:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd07a3ab800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836351.039160:0:14321:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788836351.040219:0:14321:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788836351.040278:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788836351.046811:0:14321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836351.046894:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788836351.047051:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788836351.050822:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788836351.050831:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788836351.057592:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836351.057609:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836351.057657:0:14321:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788836351.057680:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90a3a6 00000100:00080000:0.0:1788836351.057692:0:14321:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836351.057698:0:14321:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07a3ab800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836351.057734:0:14321:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07af25c00 x1875730538516096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836351.057805:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538516096:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788836351.057859:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538516096 offset 0 length 520: 4 00000100:00080000:0.0:1788836351.057933:0:14321:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788836351.058008:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836351.058012:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.058015:0:14321:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788836351.058018:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836351.058020:0:14321:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788836351.058022:0:14321:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836351.058023:0:14321:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836351.058025:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836351.058027:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.058029:0:14321:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836351.058031:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836351.058035:0:14321:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788836351.058038:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.058039:0:14321:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788836351.058042:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836351.058046:0:14321:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:0.0:1788836351.058066:0:14321:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788836351.058069:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836351.058086:0:14321:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd07d37cd28) 00000020:00000080:0.0:1788836351.058099:0:14321:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788836351.058104:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836351.058159:0:14321:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788836351.058165:0:14321:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788836351.058170:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcb5b7bc40b90a3b4 00010000:00080000:0.0:1788836351.058198:0:14321:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd078fef800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788836351.058440:0:14321:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788836351.058628:0:14321:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788836351.058648:0:14321:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788836351.059127:0:14321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836351.059192:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788836351.059257:0:14321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788836351.065693:0:14327:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836351.065702:0:14327:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788836351.069609:0:14321:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836351.069625:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788836351.069659:0:14321:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788836351.069681:0:14321:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90a3bb 00000100:00080000:0.0:1788836351.069692:0:14321:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836351.069698:0:14321:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd078fef800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836351.069734:0:14321:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07af24700 x1875730538516224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836351.069755:0:14321:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788836351.069806:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836351.069810:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.069811:0:14321:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788836351.069814:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836351.069818:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.069819:0:14321:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836351.069822:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836351.069824:0:14321:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788836351.069826:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836351.069837:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.069839:0:14321:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788836351.069842:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836351.069845:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.069846:0:14321:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788836351.069850:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788836351.069880:0:14321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14321:1875730538516352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836351.069964:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.070087:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538516224:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788836351.070118:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538516224 offset 0 length 520: 4 00000100:00100000:0.0:1788836351.071543:0:14321:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047fbb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836351.072138:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516352 00000100:00100000:1.0:1788836351.072147:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516352 00000100:00100000:1.0:1788836351.072239:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836351.072249:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14321:x1875730538516352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836351.072572:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14321:x1875730538516352:12345-0@lo:502:llog_process_th.0 Request processed in 323us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836351.072580:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836351.072682:0:14321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14321:1875730538516352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836351.072712:0:14321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836351.072719:0:14321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836351.072721:0:14321:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788836351.072724:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788836351.072879:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788836351.072916:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788836351.072936:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.072947:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999000/0xcb5b7bc40b90a344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a34b expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836351.072955:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf45ede000 from 1 10000000:01000000:2.0:1788836351.072958:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836351.072989:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.072997:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.073006:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.073026:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836351.073061:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.081301:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.081634:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516480 00000100:00100000:3.0:1788836351.081645:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516480 00000100:00100000:3.0:1788836351.081694:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836351.081720:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+9:14285:x1875730538516480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836351.081739:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836351.081757:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a3c2 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.081784:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 10 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.081796:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 10 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.081804:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d400, rc 0) 00000100:00100000:3.0:1788836351.081871:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+10:14285:x1875730538516480:12345-0@lo:101:mount.lustre.0 Request processed in 154us (8809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.081878:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836351.082006:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836351.082025:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.082034:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.082619:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516608:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788836351.082734:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.082760:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.083024:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516608 00000100:00100000:3.0:1788836351.083030:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516608 00000100:00100000:3.0:1788836351.083056:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836351.083064:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+10:14285:x1875730538516608:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788836351.083081:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788836351.083087:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788836351.083152:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+10:14285:x1875730538516608:12345-0@lo:256:mount.lustre.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.083159:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836351.083304:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516608:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788836351.083910:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836351.083930:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.083940:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836351.083948:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf45ede000 from 1 10000000:01000000:2.0:1788836351.083952:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836351.083984:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.083992:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.084002:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.084019:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836351.084057:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.084093:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.084479:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516736 00000100:00100000:3.0:1788836351.084486:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516736 00000100:00100000:3.0:1788836351.084516:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836351.084523:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+10:14285:x1875730538516736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836351.084546:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836351.084559:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a3d0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.084580:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.084590:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.084599:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d000, rc 0) 00000100:00100000:3.0:1788836351.084652:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538516736:12345-0@lo:101:mount.lustre.0 Request processed in 129us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.084659:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836351.084799:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836351.084812:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.084832:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.084884:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836351.084981:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.085112:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836351.085779:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516864 00000100:00100000:1.0:1788836351.085786:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516864 00000100:00100000:1.0:1788836351.085818:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836351.085826:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538516864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836351.086255:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538516864:12345-0@lo:501:mount.lustre.0 Request processed in 429us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836351.086263:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836351.086404:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836351.086444:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836351.086486:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.086503:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836351.086565:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538516992 00000100:00100000:1.0:1788836351.086573:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538516992 00000100:00100000:1.0:1788836351.086590:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836351.086596:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538516992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836351.086857:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538516992:12345-0@lo:503:mount.lustre.0 Request processed in 260us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836351.086863:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836351.087135:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538516992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836351.087595:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14329:1875730538517120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836351.087747:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836351.087806:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048a2c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836351.087838:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517120 00000100:00100000:2.0:1788836351.087843:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517120 00000100:00100000:2.0:1788836351.087957:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836351.087966:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14329:x1875730538517120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836351.088171:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14329:x1875730538517120:12345-0@lo:502:llog_process_th.0 Request processed in 206us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836351.088177:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836351.088246:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14329:1875730538517120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836351.088273:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836351.088283:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.088296:0:14329:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788836351.088304:0:14329:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bcf45ede000 00000020:00000080:1.0:1788836351.088307:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836351.088324:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836351.088328:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.088330:0:14329:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788836351.088332:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836351.088335:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.088336:0:14329:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788836351.088339:0:14329:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bcf45ede000 00000020:00000080:1.0:1788836351.088360:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788836351.088425:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836351.088430:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.088431:0:14329:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788836351.088434:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836351.088436:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.088438:0:14329:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788836351.088442:0:14329:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bcf45ede000 00000020:00000080:1.0:1788836351.088450:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788836351.088488:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14329:1875730538517248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836351.088523:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836351.092240:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd048a2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836351.092378:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517248 00000100:00100000:0.0:1788836351.092387:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517248 00000100:00100000:0.0:1788836351.092434:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836351.092443:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14329:x1875730538517248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836351.095848:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14329:x1875730538517248:12345-0@lo:502:llog_process_th.0 Request processed in 3398us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836351.095875:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836351.096149:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14329:1875730538517248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836351.096183:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836351.096191:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836351.096193:0:14329:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788836351.096197:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788836351.097009:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788836351.097034:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836351.097059:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.097071:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836351.097134:0:14285:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836351.097137:0:14285:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bcf45ede000 10000000:01000000:0.0:1788836351.097140:0:14285:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bcf45ede000 10000000:01000000:0.0:1788836351.097144:0:14285:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836351.097149:0:14285:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bcf45ede000 from 1 10000000:01000000:0.0:1788836351.097152:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836351.097186:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.097194:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.097203:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836351.097225:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836351.097279:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836351.097766:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047fbbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836351.102267:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517376 00000100:00100000:1.0:1788836351.102282:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517376 00000100:00100000:1.0:1788836351.103047:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836351.103057:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538517376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836351.103075:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836351.103092:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978b800/0xcb5b7bc40b90a3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a3de expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836351.103121:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978b800/0xcb5b7bc40b90a3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3de expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836351.103134:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978b800/0xcb5b7bc40b90a3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3de expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836351.103143:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978b800, rc 0) 00000100:00100000:1.0:1788836351.103225:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14285:x1875730538517376:12345-0@lo:101:mount.lustre.0 Request processed in 169us (5945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836351.103232:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836351.104437:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836351.104463:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.104476:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.104560:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836351.104610:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.104658:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836351.105005:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517504 00000100:00100000:1.0:1788836351.105016:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517504 00000100:00100000:1.0:1788836351.105048:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836351.105057:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14285:x1875730538517504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836351.105402:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836351.105439:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836351.109091:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.109188:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.111031:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517632 00000100:00100000:3.0:1788836351.111046:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517632 00000100:00100000:3.0:1788836351.111102:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788836351.111113:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14285:x1875730538517632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836351.111388:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14285:x1875730538517632:12345-0@lo:503:mount.lustre.0 Request processed in 276us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.111397:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836351.111593:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538517632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836351.112860:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14334:1875730538517760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836351.113004:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.113049:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bade40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.113104:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517760 00000100:00100000:3.0:1788836351.113111:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517760 00000100:00100000:3.0:1788836351.113155:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788836351.113164:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14334:x1875730538517760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836351.114728:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14334:x1875730538517760:12345-0@lo:502:llog_process_th.0 Request processed in 1557us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.114751:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836351.115488:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14285:x1875730538517504:12345-0@lo:501:mount.lustre.0 Request processed in 10429us (10875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836351.115498:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836351.119727:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14334:1875730538517760:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788836351.119878:0:14334:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788836351.120466:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bd07bbd3370) 00000020:00000080:3.0:1788836351.120491:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788836351.120575:0:14334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bcf45ede000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788836351.120579:0:14334:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bcf45ede000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788836351.120581:0:14334:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bcf45ede000 4 00010000:00080000:3.0:1788836351.120609:0:14334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd04ebfb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836351.125218:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788836351.125495:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788836351.125530:0:14334:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836351.125541:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcb5b7bc40b90a3f3 00000100:00080000:3.0:1788836351.125552:0:14334:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836351.125558:0:14334:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd04ebfb000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836351.125608:0:14334:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e65500 x1875730538517888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836351.125643:0:14334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788836351.127393:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538517888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788836351.127479:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836351.128606:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538517888 00000100:00100000:0.0:1788836351.128629:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538517888 00000100:00100000:0.0:1788836351.128664:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836351.128672:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538517888:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836351.128754:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538517888:12345-0@lo:38:llog_process_th.0 Request processed in 81us (1275us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788836351.128761:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836351.129077:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836351.129086:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836351.129090:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788836351.129093:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538517888:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836351.129499:0:14334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14334:1875730538518016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836351.129552:0:14334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836351.129581:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518016 00000100:00100000:3.0:1788836351.129585:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518016 00000100:00100000:3.0:1788836351.129625:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836351.129640:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14334:x1875730538518016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836351.129853:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14334:x1875730538518016:12345-0@lo:502:llog_process_th.0 Request processed in 213us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.129861:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836351.130012:0:14334:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06539a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836351.130028:0:14334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e8cc5c45-b703-4cf0-83fd-6722cde04691:14334:1875730538518016:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788836351.130049:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788836351.130103:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788836351.130121:0:14285:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788836351.130135:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.130144:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd08217d400/0xcb5b7bc40b90a3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a3e5 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788836351.130188:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788836351.130190:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836351.130191:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836351.130192:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836351.130193:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836351.130194:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836351.130196:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836351.130197:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836351.130199:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836351.130200:0:14285:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836351.130204:0:14285:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788836351.130206:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836351.130208:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788836351.130209:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836351.130210:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836351.130210:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836351.130211:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836351.130217:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788836351.130218:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788836351.130219:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836351.130220:0:14285:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788836351.130232:0:14285:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788836351.130241:0:14285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538518144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836351.130269:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836351.130297:0:14285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd06539a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836351.131422:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518144 00000100:00100000:2.0:1788836351.131431:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518144 00000100:00100000:2.0:1788836351.131472:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836351.131481:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14285:x1875730538518144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788836351.131508:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788836351.131521:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836351.212259:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836351.212285:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788836351.212373:0:14319:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788836351.212378:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788836351.212404:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.212422:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.212444:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.212484:0:14319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836351.212499:0:14319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 12 pid: 14296 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836351.212514:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538518272:0@lo:104: 00000100:00100000:2.0:1788836351.212581:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836351.212651:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bad480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836351.212741:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518272 00000100:00100000:0.0:1788836351.212757:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518272 00000100:00100000:0.0:1788836351.212806:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836351.212816:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538518272:12345-0@lo:104: 00010000:00010000:0.0:1788836351.212827:0:14286:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.212950:0:14286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836351.212957:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538518272:12345-0@lo:104: Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836351.212963:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788836351.212984:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836351.212990:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.212996:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836351.212999:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213007:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836351.213014:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836351.213019:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836351.213045:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213050:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836351.213079:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213092:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213107:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836351.213108:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836351.213110:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836351.213140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8cc5c45-b703-4cf0-83fd-6722cde04691:3305:1875730538518400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836351.213169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836351.213234:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518400 00000100:00100000:0.0:1788836351.213238:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518400 00010000:00010000:0.0:1788836351.213255:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 13 pid: 14296 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836351.213278:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836351.213284:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:3305:x1875730538518400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836351.213295:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836351.213300:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 13 pid: 14296 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213320:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 13 pid: 14296 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213337:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213389:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836351.213403:0:14288:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001025542s 00010000:00010000:0.0:1788836351.213413:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213421:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213427:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213433:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213438:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836351.213442:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213449:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213458:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836351.213468:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836351.213499:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:3305:x1875730538518400:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836351.213506:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836351.213545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8cc5c45-b703-4cf0-83fd-6722cde04691:3305:1875730538518400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836351.219429:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3c2 expref: 12 pid: 14296 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836351.219451:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538518272:0@lo:104: 00010000:00010000:3.0:1788836351.219477:0:14319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.219487:0:14319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.219493:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836351.219499:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998000/0xcb5b7bc40b90a3fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836351.225175:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14285:x1875730538518144:12345-0@lo:253:mount.lustre.0 Request processed in 93684us (94894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836351.225190:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836351.225276:0:14285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14285:1875730538518144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788836351.225295:0:14285:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788836351.225298:0:14285:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836351.225326:0:14285:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788836351.225327:0:14285:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836351.225329:0:14285:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836351.225330:0:14285:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836351.225331:0:14285:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836351.225332:0:14285:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788836351.225333:0:14285:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788836351.225335:0:14285:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836351.225336:0:14285:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788836351.225453:0:14285:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788836351.238879:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.239194:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788836351.239524:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.239685:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788836351.241203:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.241875:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788836351.244812:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.245111:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788836351.245399:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.245614:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788836351.245878:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788836351.246055:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788836351.278148:0:14285:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788836351.278596:0:14285:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788836351.278665:0:14341:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788836351.278669:0:14341:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788836351.279178:0:14342:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788836351.279256:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836351.282062:0:14342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788836351.282217:0:14342:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788836351.282221:0:14342:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788836351.284685:0:14285:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788836351.284892:0:14285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788836351.285582:0:14285:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788836351.285591:0:14285:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788836351.285810:0:14285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836351.287557:0:14285:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788836351.288327:0:14285:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788836351.288451:0:14285:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788836351.290630:0:14285:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788836351.297213:0:14285:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788836351.325633:0:14285:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788836351.325679:0:14285:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7ccc1953988 00100000:10000000:3.0:1788836351.325688:0:14285:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788836351.327085:0:14285:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836351.327102:0:14285:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836351.327116:0:14285:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788836351.327132:0:14285:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788836351.700842:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836352.149797:0:14300:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836352.149804:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf45ede000 from 6 10000000:01000000:2.0:1788836352.149809:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836352.149847:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.149870:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.149883:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836352.149904:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538518528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836352.149963:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836352.150005:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836352.150024:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518528 00000100:00100000:2.0:1788836352.150029:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518528 00000100:00100000:2.0:1788836352.150077:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836352.150085:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14300:x1875730538518528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836352.150097:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836352.150108:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a401 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836352.150113:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836352.150128:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.150138:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.150146:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998e00, rc 0) 00000100:00100000:2.0:1788836352.150180:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538518528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836352.150187:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836352.150237:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538518528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836352.150250:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.150258:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836352.150317:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538518656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836352.150367:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836352.150381:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836352.150395:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518656 00000100:00100000:2.0:1788836352.150398:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518656 00000100:00100000:2.0:1788836352.150420:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836352.150425:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538518656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788836352.150438:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836352.150453:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836352.150456:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788836352.150527:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538518656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836352.150533:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836352.150561:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538518656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836352.150595:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836352.150601:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836352.150609:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836352.723633:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836353.168992:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836353.746339:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836354.768535:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836355.798007:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836356.136034:0:14585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788836356.448934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836356.448941:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836356.448943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836356.448946:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836356.448948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788836356.448951:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836356.448954:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836356.448964:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd04ebfb000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836356.448985:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e64700 x1875730538518912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836356.449461:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836356.449475:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538518784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836356.449536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836356.453610:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518784 00000100:00100000:3.0:1788836356.453626:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518784 00000100:00100000:3.0:1788836356.453693:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836356.453704:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:3303:x1875730538518784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836356.453804:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:3303:x1875730538518784:12345-0@lo:400:kworker.0 Request processed in 102us (4266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836356.453827:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836356.453972:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538518912:0@lo:38:kworker.0 00000100:00100000:3.0:1788836356.454009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836356.454136:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538518912 00000100:00100000:2.0:1788836356.454140:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538518912 00000100:00100000:2.0:1788836356.454160:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836356.454165:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1875730538518912:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788836356.454188:0:14305:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:2.0:1788836356.454217:0:14305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcb5b7bc40b90a40f 00000004:00100000:2.0:1788836356.454230:0:14305:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788836356.454569:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538518784:0@lo:400:kworker.0 00000100:00080000:2.0:1788836356.456730:0:14305:0:(import.c:65:import_set_state_nolock()) ffff9bd048716000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836356.456825:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875730538518912:12345-0@lo:38:kworker.0 Request processed in 2657us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836356.456834:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836356.465954:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bcf45e64700 x1875730538518912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836356.465976:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788836356.465983:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788836356.465988:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836356.465991:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836356.465998:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875730538518912:0@lo:38:kworker.0 00010000:00010000:1.0:1788836356.817773:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836357.840578:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836358.865370:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788836359.536268:0:14735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd2e10ac0 20000000:00000080:3.0:1788836359.536285:0:14735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd048225c00 uarg=0000000000000000 20000000:01000000:3.0:1788836359.536316:0:14735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788836359.536323:0:14735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788836359.536328:0:14735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788836359.538674:0:14736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788836359.538835:0:14735:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788836359.549616:0:14735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836359.549898:0:14735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.549925:0:14735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.549935:0:14735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.549997:0:14735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.550029:0:14735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836359.550047:0:14735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14735:1875730538519040:0@lo:104: 00000100:00100000:2.0:1788836359.550145:0:14735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836359.550228:0:14735:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427480 going to sleep for 11 seconds 00000100:00100000:1.0:1788836359.550570:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519040 00000100:00100000:1.0:1788836359.550584:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519040 00000100:00100000:1.0:1788836359.550708:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836359.550719:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14735:x1875730538519040:12345-0@lo:104: 00010000:00010000:1.0:1788836359.550747:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836359.550841:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836359.550848:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14735:x1875730538519040:12345-0@lo:104: Request processed in 132us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836359.550855:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788836359.551719:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836359.551735:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.551747:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836359.551753:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.551765:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836359.551793:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836359.551800:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836359.551862:0:14291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.551868:0:14291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836359.551895:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.551902:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998800/0xcb5b7bc40b90a3d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a3d7 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.551926:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836359.551928:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836359.551930:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836359.551952:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836359.551972:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538519168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836359.552042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836359.552098:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519168 00000100:00100000:0.0:1788836359.552106:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519168 00010000:00010000:0.0:1788836359.552148:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 12 pid: 14296 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836359.552179:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836359.552188:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:3302:x1875730538519168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836359.552201:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836359.552213:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 12 pid: 14296 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552227:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 12 pid: 14296 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552248:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552268:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552286:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552295:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552303:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552309:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552314:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836359.552318:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.552326:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.553311:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836359.553521:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836359.553603:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:3302:x1875730538519168:12345-0@lo:103:ldlm_bl.0 Request processed in 1414us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836359.553613:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788836359.556756:0:14735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a3d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a3d0 expref: 11 pid: 14296 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836359.556779:0:14735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14735:1875730538519040:0@lo:104: 00010000:00010000:2.0:1788836359.556806:0:14735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.556817:0:14735:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.556822:0:14735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836359.556828:0:14735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999200/0xcb5b7bc40b90a416 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836359.558919:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538519168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836359.888563:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836360.912800:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836361.040962:0:14300:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836361.040970:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf45ede000 from 10 10000000:01000000:2.0:1788836361.040975:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836361.041053:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836361.041064:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836361.041074:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836361.041096:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836361.041154:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836361.041815:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0494279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836361.048944:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519296 00000100:00100000:3.0:1788836361.048960:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519296 00000100:00100000:3.0:1788836361.049022:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836361.049033:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+11:14300:x1875730538519296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836361.049050:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836361.049069:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a41d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836361.049098:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836361.049110:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836361.049119:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0d400, rc 0) 00000100:00100000:3.0:1788836361.049287:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538519296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (8131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836361.049295:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836361.050414:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836361.050438:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836361.050450:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836361.050975:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836361.051137:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836361.051181:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0494279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836361.051470:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519424 00000100:00100000:3.0:1788836361.051478:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519424 00000100:00100000:3.0:1788836361.053171:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836361.053192:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538519424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836361.054805:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538519424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1617us (3662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836361.054818:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836361.055216:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836361.055276:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836361.055375:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836361.060985:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0494279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836361.066674:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519552 00000100:00100000:0.0:1788836361.066690:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519552 00000100:00100000:0.0:1788836361.070979:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836361.070993:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538519552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836361.071385:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14300:x1875730538519552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 394us (16043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836361.071393:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836361.072726:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538519552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836361.083014:0:14796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788836361.083205:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788836361.083228:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836361.083240:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836361.083262:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836361.552611:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836351/real 1788836351] req@ffff9bd07af24700 x1875730538516224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836361 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836361.552642:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07af24700 x1875730538516224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836361 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836361.552652:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836351/real 1788836351] req@ffff9bd07af25c00 x1875730538516096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836361 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836361.552682:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd07af25c00 x1875730538516096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836361 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836361.552698:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836361.552756:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836361.552760:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538516224:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788836361.552766:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836361.552922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836361.552927:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788836361.552930:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836361.552934:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:3.0:1788836361.552938:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836361.552944:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07a3ab800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836361.552977:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e66680 x1875730538519680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836361.552998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836361.553001:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836361.553003:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836361.553005:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:3.0:1788836361.553007:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836361.553010:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd078fef800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836361.553021:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e66d80 x1875730538519808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836361.553264:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836361.553269:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538516096:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788836361.553292:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538519936:0@lo:400:kworker.0 00000100:00100000:0.0:1788836361.553296:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538519680:0@lo:8:kworker.0 00000100:00100000:2.0:1788836361.572176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836361.572288:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538519936 00000100:00100000:2.0:1788836361.572296:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538519936 00000100:00100000:2.0:1788836361.572360:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836361.572369:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538519936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836361.572431:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538519936:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836361.572439:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788836361.572492:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bcf45e66a00 x1875730538519936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836361.572507:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538519936:0@lo:400:kworker.0 00000400:00000100:0.0:1788836361.574377:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538519680 offset 0 length 520: 4 00000100:00100000:0.0:1788836361.574529:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538519808:0@lo:8:kworker.0 00000400:00000100:0.0:1788836361.574639:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730538519808 offset 0 length 520: 4 00010000:00010000:1.0:1788836361.937601:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836362.965171:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836363.415534:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836363.988694:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836364.844188:0:14984:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836364.844310:0:14984:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788836364.844573:0:14984:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd04ea62000 00000020:01000004:2.0:1788836364.844588:0:14984:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788836364.844599:0:14984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788836364.844612:0:14984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd044d019b8) 00000020:00000080:2.0:1788836364.844627:0:14984:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788836364.873930:0:14984:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788836364.875997:0:14984:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788836364.878793:0:14984:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788836364.879330:0:14984:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788836364.879615:0:14984:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788836364.880039:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 499: rc = 0 00100000:10000000:3.0:1788836364.880140:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:3.0:1788836364.880657:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 499: rc = 0 00100000:10000000:3.0:1788836364.882552:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 163: rc = 0 00100000:10000000:3.0:1788836364.882830:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 163: rc = 0 00100000:10000000:3.0:1788836364.883610:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 163: rc = 0 00100000:10000000:3.0:1788836364.883883:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 163: rc = 0 00100000:10000000:3.0:1788836364.884133:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 163: rc = 0 00100000:10000000:3.0:1788836364.884653:0:14984:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 163: rc = 0 00000020:00000080:3.0:1788836364.885415:0:14984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788836364.885426:0:14984:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836364.885437:0:14984:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b90a432 00000020:01000004:3.0:1788836364.885445:0:14984:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788836364.885465:0:14984:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788836364.885468:0:14984:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788836364.885474:0:14984:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788836364.885478:0:14984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788836364.885498:0:14984:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd0482cb370) 00000020:00000080:3.0:1788836364.885510:0:14984:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788836364.887954:0:14984:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836364.888174:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788836364.888185:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788836364.904853:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836364.904869:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788836364.906262:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788836364.906282:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788836364.909175:0:14984:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836364.909567:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788836364.909573:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788836364.910229:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788836364.910237:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788836364.936964:0:14984:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836364.938688:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788836364.938697:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788836364.939932:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788836364.939944:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788836364.943278:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788836364.943290:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788836364.945815:0:14984:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836364.946197:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788836364.946203:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788836364.950187:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836364.950201:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788836364.999614:0:14984:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836364.999825:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836364.999831:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788836365.000923:0:14984:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836365.000932:0:14984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788836365.002091:0:14984:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788836365.002116:0:14984:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788836365.002122:0:14984:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:0.0:1788836365.009442:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788836365.009695:0:14984:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836365.009728:0:14984:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788836365.009732:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836365.009734:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836365.009735:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836365.009736:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836365.009737:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836365.009739:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836365.009740:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836365.009742:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836365.009743:0:14984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836365.009746:0:14984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788836365.009748:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836365.009749:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836365.009750:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836365.009751:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836365.009752:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836365.009753:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836365.009754:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836365.009755:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836365.009756:0:14984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836365.009778:0:14984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788836365.009796:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836365.009871:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.009979:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047ae8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.009992:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520064 00000100:00100000:0.0:1788836365.010001:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520064 00000100:00100000:0.0:1788836365.010056:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788836365.010066:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14984:x1875730538520064:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836365.010093:0:14297:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788836365.010097:0:14297:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788836365.010100:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788836365.015801:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14984:x1875730538520064:12345-0@lo:253:mount.lustre.0 Request processed in 5726us (5918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.015816:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836365.015904:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836365.015920:0:14984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788836365.015923:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836365.015925:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788836365.015926:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836365.015927:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836365.015929:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836365.015930:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836365.015931:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836365.015933:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836365.015934:0:14984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836365.015952:0:14984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd04ea62000 from lustre-OST0000 10000000:01000000:3.0:1788836365.015977:0:14984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788836365.015979:0:14984:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836365.015986:0:14984:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd07b2b19b8 local copy 00010000:00010000:3.0:1788836365.015996:0:14984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.016203:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836365.016251:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.016322:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709780 going to sleep for 11 seconds 00000100:00100000:1.0:1788836365.016430:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520192 00000100:00100000:1.0:1788836365.016437:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520192 00000100:00100000:1.0:1788836365.016480:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788836365.016488:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14984:x1875730538520192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836365.016776:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14984:x1875730538520192:12345-0@lo:501:mount.lustre.0 Request processed in 287us (522us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836365.016792:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836365.016848:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520192:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788836365.016861:0:14984:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788836365.016985:0:14984:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788836365.016992:0:14984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017001:0:14984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836365.017027:0:14984:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd04ea62000 10000000:01000000:3.0:1788836365.017031:0:14984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836365.017035:0:14984:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd07b2b19b8 10000000:01000000:3.0:1788836365.017037:0:14984:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788836365.017040:0:14984:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd07b2b19b8 from 1 10000000:01000000:3.0:1788836365.017043:0:14984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788836365.017066:0:14984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017073:0:14984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017082:0:14984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.017097:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836365.017123:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.017187:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709780 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.017231:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520320 00000100:00100000:0.0:1788836365.017235:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520320 00000100:00100000:0.0:1788836365.017301:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836365.017309:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+12:14984:x1875730538520320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836365.017319:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836365.017332:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90a447 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a440 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.017377:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90a447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a440 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.017387:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217c800/0xcb5b7bc40b90a447 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a440 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.017395:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217c800, rc 0) 00000100:00100000:0.0:1788836365.017430:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14984:x1875730538520320:12345-0@lo:101:mount.lustre.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.017435:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788836365.017521:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836365.017532:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017540:0:14984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836365.017555:0:14984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788836365.017580:0:14984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017597:0:14984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0de00/0xcb5b7bc40b90a440 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a447 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836365.017603:0:14984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836365.017606:0:14984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836365.017610:0:14984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788836365.017612:0:14984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836365.017625:0:14984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017632:0:14984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.017639:0:14984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.017650:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836365.017674:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.017838:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709780 going to sleep for 11 seconds 00000100:00100000:2.0:1788836365.017898:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520448 00000100:00100000:2.0:1788836365.017903:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520448 00000100:00100000:2.0:1788836365.017925:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836365.017931:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+13:14984:x1875730538520448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836365.017937:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836365.017946:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b90a455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a44e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836365.017959:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b90a455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a44e expref: 14 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836365.017967:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998c00/0xcb5b7bc40b90a455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a44e expref: 14 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836365.017980:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998c00, rc 0) 00000100:00100000:2.0:1788836365.018051:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520448:12345-0@lo:101:mount.lustre.0 Request processed in 120us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836365.018057:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788836365.018159:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836365.018168:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.018175:0:14984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836365.018932:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788836365.019819:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836365.020074:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788836365.020115:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788836365.020144:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788836365.020187:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788836365.020235:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788836365.020270:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788836365.020329:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788836365.020337:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788836365.020439:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836365.020490:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.020524:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.020596:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520576 00000100:00100000:0.0:1788836365.020603:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520576 00000100:00100000:0.0:1788836365.020647:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788836365.020655:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836365.020943:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520576:12345-0@lo:501:mount.lustre.0 Request processed in 288us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.020950:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836365.021053:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836365.021088:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836365.021123:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.021147:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054badc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.021200:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520704 00000100:00100000:0.0:1788836365.021204:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520704 00000100:00100000:0.0:1788836365.021238:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836365.021245:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836365.021511:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520704:12345-0@lo:503:mount.lustre.0 Request processed in 266us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.021518:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836365.021600:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836365.022040:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836365.022114:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836365.022151:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.022183:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054badc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.022258:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520832 00000100:00100000:0.0:1788836365.022263:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520832 00000100:00100000:0.0:1788836365.022391:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836365.022399:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836365.022562:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520832:12345-0@lo:502:mount.lustre.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.022569:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836365.022702:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836365.022906:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788836365.022950:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788836365.022993:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788836365.023036:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788836365.023068:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788836365.023098:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788836365.023138:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788836365.023169:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788836365.023197:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788836365.023254:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788836365.023288:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788836365.023329:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788836365.023379:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836365.023420:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.023516:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054badc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.023593:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538520960 00000100:00100000:3.0:1788836365.023599:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538520960 00000100:00100000:3.0:1788836365.023625:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836365.023631:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836365.023767:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538520960:12345-0@lo:502:mount.lustre.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.023774:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836365.023849:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538520960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836365.023906:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788836365.023914:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788836365.024675:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788836365.024683:0:14998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788836365.024689:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.024692:0:14998:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788836365.024697:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836365.024711:0:14998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd07b234d28) 00000020:00000080:1.0:1788836365.024730:0:14998:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788836365.024734:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836365.024796:0:14998:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd04ea62000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788836365.024803:0:14998:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788836365.024809:0:14998:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcb5b7bc40b90a463 00010000:00010000:1.0:1788836365.028133:0:14998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788836365.028605:0:14998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788836365.030190:0:14998:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788836365.031829:0:14998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788836365.031839:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836365.031845:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031848:0:14998:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788836365.031850:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788836365.031853:0:14998:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788836365.031854:0:14998:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836365.031856:0:14998:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788836365.031857:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788836365.031859:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031861:0:14998:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788836365.031863:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836365.031866:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031867:0:14998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836365.031869:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836365.031876:0:14998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836365.031879:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836365.031881:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031883:0:14998:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788836365.031884:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836365.031887:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031888:0:14998:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836365.031891:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788836365.031941:0:14998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836365.031944:0:14998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836365.031945:0:14998:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836365.031948:0:14998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788836365.032085:0:14984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788836365.032109:0:14984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788836365.032128:0:14984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.032139:0:14984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0ca00/0xcb5b7bc40b90a44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a455 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836365.032147:0:14984:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd04ea62000 from 1 10000000:01000000:3.0:1788836365.032150:0:14984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836365.032181:0:14984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.032194:0:14984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.032204:0:14984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.032237:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836365.032441:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.032475:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.032535:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521088 00000100:00100000:0.0:1788836365.032541:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521088 00000100:00100000:0.0:1788836365.032585:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788836365.032593:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+14:14984:x1875730538521088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836365.032606:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836365.032616:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a46a expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.032637:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.032647:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.032665:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217d000, rc 0) 00000100:00100000:0.0:1788836365.032741:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521088:12345-0@lo:101:mount.lustre.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.032747:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836365.037546:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836365.037574:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.037586:0:14984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836365.038201:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788836365.039807:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836365.040070:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788836365.040111:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788836365.040168:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788836365.040177:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788836365.040338:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836365.040457:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.040538:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0467099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.040609:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521216 00000100:00100000:0.0:1788836365.040615:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521216 00000100:00100000:0.0:1788836365.040694:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836365.040703:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836365.040903:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521216:12345-0@lo:501:mount.lustre.0 Request processed in 200us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.040910:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836365.040982:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836365.041016:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836365.041051:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836365.041138:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05851c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.041206:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521344 00000100:00100000:3.0:1788836365.041211:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521344 00000100:00100000:3.0:1788836365.041245:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836365.041251:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836365.041422:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521344:12345-0@lo:503:mount.lustre.0 Request processed in 171us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.041429:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788836365.041525:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788836365.042248:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836365.042313:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836365.042376:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836365.042401:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05851c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.042547:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521472 00000100:00100000:3.0:1788836365.042553:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521472 00000100:00100000:3.0:1788836365.042576:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836365.042583:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836365.042728:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521472:12345-0@lo:502:mount.lustre.0 Request processed in 144us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.042734:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836365.042810:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836365.043036:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788836365.043083:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788836365.043125:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788836365.043169:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788836365.043199:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788836365.043256:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788836365.043303:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788836365.043365:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788836365.043446:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836365.043482:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836365.043516:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05851c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.043618:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521600 00000100:00100000:3.0:1788836365.043624:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521600 00000100:00100000:3.0:1788836365.043643:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836365.043649:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836365.043790:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521600:12345-0@lo:502:mount.lustre.0 Request processed in 141us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.043797:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788836365.043867:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836365.043939:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788836365.043948:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788836365.044789:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836365.044799:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.044802:0:15002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788836365.044810:0:15002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd04ea62000 00000020:00000080:0.0:1788836365.044812:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836365.044819:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836365.044821:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.044823:0:15002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788836365.044825:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836365.044827:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.044828:0:15002:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836365.044831:0:15002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd04ea62000 00000020:00000080:0.0:1788836365.044833:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836365.044917:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836365.044921:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.044922:0:15002:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788836365.044925:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836365.044927:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.044933:0:15002:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836365.044937:0:15002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd04ea62000 00000020:00000080:0.0:1788836365.044939:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836365.045401:0:15002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836365.045406:0:15002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836365.045408:0:15002:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788836365.045412:0:15002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788836365.045587:0:14984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788836365.045621:0:14984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836365.045648:0:14984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836365.045660:0:14984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836365.045715:0:14984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788836365.045718:0:14984:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd04ea62000 10000000:01000000:1.0:1788836365.045722:0:14984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd04ea62000 10000000:01000000:1.0:1788836365.045726:0:14984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836365.045732:0:14984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd04ea62000 from 1 10000000:01000000:1.0:1788836365.045734:0:14984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788836365.045768:0:14984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836365.045776:0:14984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836365.045786:0:14984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836365.045816:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836365.045881:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.045927:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043158a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.046125:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521728 00000100:00100000:3.0:1788836365.046132:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521728 00000100:00100000:3.0:1788836365.046182:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836365.046193:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538521728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836365.046209:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836365.046237:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b90a47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a478 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.046275:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b90a47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a478 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.046284:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c800/0xcb5b7bc40b90a47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a478 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.046293:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c800, rc 0) 00000100:00100000:3.0:1788836365.046373:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538521728:12345-0@lo:101:mount.lustre.0 Request processed in 181us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.046381:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836365.046402:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836365.046419:0:14984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.046429:0:14984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836365.046943:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788836365.047415:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836365.047759:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788836365.047815:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788836365.047857:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788836365.047918:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788836365.047954:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788836365.047997:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788836365.048030:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788836365.048060:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788836365.048101:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788836365.048134:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788836365.048164:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788836365.048205:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788836365.048253:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788836365.048395:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788836365.048450:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788836365.048487:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788836365.048535:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788836365.048585:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788836365.048623:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788836365.048677:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788836365.048726:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788836365.048765:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788836365.048800:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788836365.048852:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788836365.048891:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788836365.048925:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788836365.048973:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788836365.049005:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788836365.049076:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788836365.049082:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788836365.049166:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836365.049237:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836365.049377:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836365.050103:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521856 00000100:00100000:1.0:1788836365.050111:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521856 00000100:00100000:1.0:1788836365.050161:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836365.050171:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538521856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836365.050440:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538521856:12345-0@lo:501:mount.lustre.0 Request processed in 270us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836365.050450:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788836365.050471:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836365.050511:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836365.050549:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836365.050574:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836365.051184:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538521984 00000100:00100000:1.0:1788836365.051190:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538521984 00000100:00100000:1.0:1788836365.051234:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836365.051242:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538521984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836365.051421:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538521984:12345-0@lo:503:mount.lustre.0 Request processed in 178us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836365.051429:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788836365.051445:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538521984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836365.052152:0:14984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836365.052229:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836365.052285:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836365.052305:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836365.053176:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522112 00000100:00100000:1.0:1788836365.053184:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522112 00000100:00100000:1.0:1788836365.053234:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836365.053243:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538522112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836365.053475:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538522112:12345-0@lo:502:mount.lustre.0 Request processed in 234us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836365.053483:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836365.056247:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836365.057199:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788836365.057979:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788836365.058033:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788836365.058447:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788836365.058498:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788836365.058672:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788836365.058713:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788836365.058747:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788836365.058805:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788836365.058843:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788836365.058876:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788836365.058921:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788836365.058956:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788836365.058988:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788836365.059033:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788836365.059071:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788836365.059102:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788836365.059147:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788836365.059180:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788836365.059260:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788836365.059333:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788836365.059395:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788836365.059429:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788836365.059478:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788836365.059509:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788836365.059555:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788836365.059604:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788836365.059634:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788836365.059662:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788836365.059700:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788836365.059730:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788836365.059757:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788836365.059795:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788836365.059838:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788836365.059874:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788836365.059946:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788836365.059993:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788836365.060041:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788836365.060115:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788836365.060151:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788836365.060202:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836365.060607:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836365.060663:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836365.061826:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522240 00000100:00100000:1.0:1788836365.061843:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522240 00000100:00100000:1.0:1788836365.061891:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836365.061902:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538522240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836365.062936:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538522240:12345-0@lo:502:mount.lustre.0 Request processed in 1034us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836365.062946:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836365.063698:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788836365.063817:0:14984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788836365.063833:0:14984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788836365.066298:0:15006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788836365.066316:0:15006:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd07b2319b8) 00000020:00000080:1.0:1788836365.066336:0:15006:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788836365.066422:0:15006:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd04ea62000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836365.066426:0:15006:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd04ea62000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836365.066429:0:15006:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd04ea62000 3 00010000:00080000:1.0:1788836365.066457:0:15006:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd043066000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788836365.069406:0:15006:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788836365.073645:0:15006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788836365.073760:0:15006:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836365.073773:0:15006:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcb5b7bc40b90a48d 00000100:00080000:1.0:1788836365.073783:0:15006:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836365.073789:0:15006:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd043066000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788836365.073822:0:15006:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07acb3800 x1875730538522368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836365.073852:0:15006:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836365.073884:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836365.073890:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836365.073894:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836365.073897:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836365.073947:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836365.073960:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538522496:0@lo:400:kworker.0 00000100:00100000:3.0:1788836365.074024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.074078:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522496 00000100:00100000:3.0:1788836365.074085:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522496 00000100:00100000:3.0:1788836365.074122:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836365.074131:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538522496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836365.074182:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538522496:12345-0@lo:400:kworker.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.074189:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836365.074323:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538522368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836365.074381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.074799:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522368 00000100:00100000:1.0:1788836365.074804:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522368 00000100:00100000:1.0:1788836365.074840:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836365.074852:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875730538522368:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788836365.074874:0:14303:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:1.0:1788836365.074911:0:14303:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcb5b7bc40b90a494 00000004:00100000:1.0:1788836365.074929:0:14303:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836365.074961:0:14303:0:(import.c:65:import_set_state_nolock()) ffff9bd07985d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836365.075164:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875730538522368:12345-0@lo:38:llog_process_th.0 Request processed in 311us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836365.075171:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788836365.075335:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd07acb3800 x1875730538522368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836365.075360:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836365.075367:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788836365.075374:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836365.075378:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836365.075380:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd043066000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836365.075386:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1875730538522368:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788836365.075638:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bcf45e64a80 x1875730538522496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836365.075655:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538522496:0@lo:400:kworker.0 00000040:00080000:1.0:1788836365.078255:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788836365.078306:0:14984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788836365.078333:0:14984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788836365.078378:0:14984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836365.078390:0:14984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07978b200/0xcb5b7bc40b90a478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a47f expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788836365.078438:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788836365.078440:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836365.078442:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836365.078443:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836365.078445:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836365.078446:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836365.078447:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836365.078449:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836365.078451:0:14984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836365.078455:0:14984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788836365.078457:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836365.078458:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788836365.078460:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836365.078461:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836365.078462:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836365.078466:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836365.078467:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788836365.078468:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836365.078481:0:14984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788836365.078502:0:14984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788836365.078520:0:14984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836365.078588:0:14984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836365.078628:0:14984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd043158000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836365.078645:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522624 00000100:00100000:0.0:1788836365.078655:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522624 00000100:00100000:0.0:1788836365.078700:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836365.078709:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14984:x1875730538522624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836365.078736:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788836365.078749:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836365.171880:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836365.171895:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788836365.175388:0:14319:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836365.175399:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836365.175419:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.175541:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.175551:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.175593:0:14319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 16 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.175609:0:14319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 16 pid: 14296 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.175625:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538522752:0@lo:104: 00000100:00100000:3.0:1788836365.175692:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836365.175740:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd046709e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836365.175796:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522752 00000100:00100000:3.0:1788836365.175803:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522752 00000100:00100000:3.0:1788836365.175850:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836365.175859:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538522752:12345-0@lo:104: 00010000:00010000:3.0:1788836365.175872:0:14286:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.175923:0:14286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836365.175936:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538522752:12345-0@lo:104: Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.175943:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836365.176065:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538522752:0@lo:104: 00010000:00010000:3.0:1788836365.176084:0:14319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176101:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836365.176106:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176113:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1788836365.176117:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176125:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836365.176132:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836365.176138:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836365.176173:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176180:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836365.176201:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176207:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999a00/0xcb5b7bc40b90a401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a408 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.176237:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836365.176239:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836365.176242:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836365.176280:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538522880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836365.176315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836365.176520:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538522880 00000100:00100000:0.0:1788836365.176526:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538522880 00010000:00010000:0.0:1788836365.176548:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 17 pid: 14296 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836365.176581:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836365.176589:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:3302:x1875730538522880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836365.176601:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836365.176607:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 17 pid: 14296 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176618:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 17 pid: 14296 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176645:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998e00/0xcb5b7bc40b90a408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a401 expref: 17 pid: 14296 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176659:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176667:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788836365.176680:0:14290:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001282511s 00010000:00010000:0.0:1788836365.176685:0:14290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176692:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176711:0:14290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176718:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176724:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836365.176728:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176736:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176765:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836365.176775:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836365.176814:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538522880:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836365.176821:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836365.176854:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538522880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836365.178546:0:14319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.178561:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836365.178569:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d000/0xcb5b7bc40b90a49b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836365.194053:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14984:x1875730538522624:12345-0@lo:253:mount.lustre.0 Request processed in 115338us (115457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836365.194067:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788836365.194271:0:14984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:14984:1875730538522624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836365.194286:0:14984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836365.194290:0:14984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836365.194291:0:14984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836365.194292:0:14984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836365.194293:0:14984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836365.194294:0:14984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836365.194296:0:14984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836365.194297:0:14984:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836365.194299:0:14984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836365.194301:0:14984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836365.194319:0:14984:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788836365.217694:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836365.217848:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836365.218537:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836365.218785:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788836365.219339:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788836365.220058:0:14984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788836365.221495:0:14984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788836365.278505:0:14984:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788836365.278516:0:14984:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788836365.278548:0:14984:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836365.278596:0:14984:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836365.278609:0:14984:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788836365.278632:0:14984:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788836366.034500:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836366.993538:0:14300:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836366.993547:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf45ede000 from 7 10000000:01000000:2.0:1788836366.993554:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836366.993609:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836366.993619:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836366.993631:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836366.993654:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538523008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836366.993719:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836366.993777:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0516bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836366.993881:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523008 00000100:00100000:0.0:1788836366.993888:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523008 00000100:00100000:0.0:1788836366.993943:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836366.993953:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+15:14300:x1875730538523008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836366.993966:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836366.993979:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a4a2 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836366.994014:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 16 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836366.994024:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 16 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836366.994034:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217dc00, rc 0) 00000100:00100000:0.0:1788836366.994087:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14300:x1875730538523008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836366.994093:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788836366.994138:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538523008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836366.994151:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836366.994160:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836366.994218:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538523136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788836366.994248:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836366.994262:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836366.994275:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523136 00000100:00100000:0.0:1788836366.994279:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523136 00000100:00100000:0.0:1788836366.994301:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836366.994307:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14300:x1875730538523136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836366.994321:0:14298:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836366.994336:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836366.994366:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788836366.994441:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14300:x1875730538523136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836366.994449:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788836366.994480:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538523136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788836366.994530:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836366.994537:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836366.994545:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836367.060120:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836368.084433:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836369.105669:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836370.130544:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836370.256637:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836370.256645:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836370.256648:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836370.256651:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836370.256689:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836370.256706:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538523264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.256772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836370.256822:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538523392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.256846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836370.256865:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836370.256871:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538523520:0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.256895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836370.256936:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523264 00000100:00100000:1.0:1788836370.256944:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523264 00000100:00100000:1.0:1788836370.256985:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836370.256994:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.257041:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538523264:12345-0@lo:400:kworker.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836370.257048:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836370.257087:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523392 00000100:00100000:1.0:1788836370.257091:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523392 00000100:00100000:1.0:1788836370.257114:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523520 00000100:00100000:1.0:1788836370.257117:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523520 00000100:00100000:1.0:1788836370.257136:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836370.257142:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538523392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.257175:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538523392:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836370.257181:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836370.257204:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836370.257210:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538523520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.257237:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538523520:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836370.257242:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788836370.257279:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07acb1500 x1875730538523520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836370.257306:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538523520:0@lo:400:kworker.0 00010000:00080000:1.0:1788836370.257317:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07acb0a80 x1875730538523392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836370.257325:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538523392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836370.257368:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538523264:0@lo:400:kworker.0 00000100:00080000:0.0:1788836370.257374:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836371.163125:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788836372.172647:0:15352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788836372.176860:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836373.201584:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836373.658937:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836374.227271:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836375.254014:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836375.377703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836375.377713:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836375.377717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836375.377726:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836375.377788:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538523776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836375.377919:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538523648:0@lo:400:kworker.0 00000100:00100000:0.0:1788836375.377990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836375.378055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836375.378083:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523648 00000100:00100000:0.0:1788836375.378092:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523648 00000100:00100000:3.0:1788836375.378109:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538523904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836375.378141:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836375.378165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836375.378170:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538523648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836375.378218:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523776 00000100:00100000:3.0:1788836375.378223:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523776 00000100:00100000:0.0:1788836375.378224:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538523648:12345-0@lo:400:kworker.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836375.378233:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836375.378266:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538523904 00000100:00100000:3.0:1788836375.378270:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538523904 00000100:00100000:0.0:1788836375.378295:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538523648:0@lo:400:kworker.0 00000100:00100000:3.0:1788836375.378311:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836375.378321:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538523776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836375.378401:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875730538523776:12345-0@lo:400:kworker.0 Request processed in 82us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836375.378409:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836375.378427:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836375.378439:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538523904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788836375.378452:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836375.378482:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e65500 x1875730538523776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836375.378497:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875730538523776:0@lo:400:kworker.0 00010000:00080000:3.0:1788836375.378529:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e64000 x1875730538523904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836375.378539:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538523904:0@lo:400:kworker.0 00000100:00100000:2.0:1788836375.378762:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538523904:12345-0@lo:400:kworker.0 Request processed in 283us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836375.378771:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788836376.273428:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836376.336540:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836361/real 1788836361] req@ffff9bcf45e66680 x1875730538519680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836376 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836376.336601:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bcf45e66680 x1875730538519680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836376.336614:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836361/real 1788836361] req@ffff9bcf45e66d80 x1875730538519808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836376 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836376.336628:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bcf45e66d80 x1875730538519808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836376.336652:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836376.336683:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836376.336688:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538519680:0@lo:8:kworker.0 00000100:00080000:0.0:1788836376.336694:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836376.336699:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836376.336702:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538519808:0@lo:8:kworker.0 00000100:00080000:3.0:1788836376.336848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836376.336853:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788836376.336857:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836376.336863:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1788836376.336875:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788836376.336882:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd07a3ab800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836376.336907:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e65500 x1875730538524160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836376.336922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836376.336925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836376.336926:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836376.336930:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1788836376.336932:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788836376.336935:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd078fef800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836376.336946:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e64e00 x1875730538524288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836376.336990:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836376.337003:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538524032:0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.337171:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.337224:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836376.337230:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538524544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.337288:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524032 00000100:00100000:3.0:1788836376.337297:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524032 00000100:00100000:3.0:1788836376.337578:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836376.337592:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3304:x1875730538524032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337663:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3304:x1875730538524032:12345-0@lo:400:kworker.0 Request processed in 72us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836376.337680:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836376.337720:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524416 00000100:00100000:3.0:1788836376.337724:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524416 00000100:00100000:3.0:1788836376.337751:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524544 00000100:00100000:3.0:1788836376.337754:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524544 00000100:00100000:3.0:1788836376.337770:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836376.337777:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538524416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337817:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538524416:12345-0@lo:400:kworker.0 Request processed in 40us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836376.337823:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836376.337835:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836376.337841:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538524544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337869:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538524544:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836376.337875:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788836376.337919:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e65880 x1875730538524544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836376.337932:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538524544:0@lo:400:kworker.0 00010000:00080000:3.0:1788836376.337942:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e65180 x1875730538524416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836376.337950:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788836376.337974:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538524160:0@lo:8:kworker.0 00000100:00100000:3.0:1788836376.338006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.338032:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538524288:0@lo:8:kworker.0 00000100:00100000:3.0:1788836376.338066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.338111:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524160 00000100:00100000:3.0:1788836376.338180:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524160 00000100:00100000:3.0:1788836376.338200:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524288 00000100:00100000:3.0:1788836376.338203:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524288 00000100:00100000:3.0:1788836376.338214:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836376.338219:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538524160:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788836376.338247:0:14985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:3.0:1788836376.338280:0:14985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90a4b0 00002000:00100000:3.0:1788836376.338296:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd04790c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788836376.338300:0:14985:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788836376.338304:0:14985:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788836376.338468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538524032:0@lo:400:kworker.0 00002000:00080000:3.0:1788836376.338909:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788836376.338939:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9bd04790c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836376.339056:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538524160:12345-0@lo:8:kworker.0 Request processed in 834us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836376.339065:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836376.339085:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836376.339091:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538524288:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788836376.339106:0:14985:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836376.339157:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538524288:12345-0@lo:8:kworker.0 Request processed in 64us (1089us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836376.339163:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788836376.341291:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e65500 x1875730538524160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836376.341309:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836376.341320:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788836376.341331:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836376.341339:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788836376.342000:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd07a3ab800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836376.342023:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836376.342033:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538524160:0@lo:8:kworker.0 00000004:00080000:2.0:1788836376.342151:0:14325:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788836376.342626:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429477282336ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788836376.342691:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836376.342697:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788836376.342702:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538524288:0@lo:8:kworker.0 00000004:00080000:3.0:1788836376.343624:0:14326:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788836376.343654:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14326:1875730538524800:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788836376.343734:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836376.343779:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0517dfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836376.343802:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524800 00000100:00100000:3.0:1788836376.343809:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524800 00000100:00100000:3.0:1788836376.343871:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836376.343882:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14326:x1875730538524800:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788836376.346257:0:14985:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788836376.346269:0:14985:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788836376.346276:0:14985:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:0.0:1788836376.351718:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836376.351757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538524672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836376.351856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788836376.354389:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836376.363246:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524672 00000100:00100000:2.0:1788836376.363268:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524672 00000100:00100000:2.0:1788836376.363355:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836376.363368:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875730538524672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836376.363419:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836376.363538:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875730538524672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (11682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836376.363563:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788836376.364387:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e67480 x1875730538524672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836376.364417:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538524672:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788836376.375438:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.375455:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375476:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.375483:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.375491:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375512:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375525:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375535:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375556:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836376.375572:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.375586:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375595:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.375599:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375608:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375630:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375637:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a4b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.375656:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.375658:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.375660:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.376526:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.376536:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.376550:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.376553:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.376558:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.376582:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.376592:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.376600:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.376623:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.377068:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.377075:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.377084:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.377087:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.377091:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.377101:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.377109:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.377128:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386175:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836376.386214:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836376.386226:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386243:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.386249:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386262:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386288:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386296:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a4be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386317:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.386321:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.386363:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.386366:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.386660:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.387324:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.393978:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.393998:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a4c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836376.394207:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836376.394217:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394233:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1788836376.394238:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836376.394247:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394262:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394274:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394282:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394318:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836376.394851:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836376.394859:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394878:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1788836376.394881:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836376.394885:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.394895:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395117:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.395126:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395134:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.395138:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395157:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395175:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395189:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db289c49/0xcb5b7bc40b90a4cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.395207:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.395209:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.395212:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.396456:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.396468:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.396642:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.397307:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.397316:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397330:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.397335:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.397366:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397390:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397400:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397407:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397416:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836376.397529:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836376.397537:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397546:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836376.397551:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397562:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397593:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397602:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a4d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397621:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836376.397625:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397631:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ce00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836376.397634:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397642:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397650:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397656:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a4da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.397666:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.397668:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.397675:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.397825:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.397831:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397839:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.397842:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.397847:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397856:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397865:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397872:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397886:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836376.397893:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.397897:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397903:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0dc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.397907:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397926:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397937:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397945:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000095322de/0xcb5b7bc40b90a4e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.397958:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.397959:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.397961:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.398376:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.398383:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398393:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.398396:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.398400:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398410:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398418:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398431:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398444:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836376.398452:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.398456:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398463:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.398467:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398474:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398485:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398491:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005626517f/0xcb5b7bc40b90a4e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398503:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.398504:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.398506:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.398874:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.398886:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398894:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.398898:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.398902:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398912:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398920:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398927:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398939:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836376.398946:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.398950:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398957:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0cc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.398961:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398969:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398986:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.398992:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a4ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.399004:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.399005:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.399006:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.400709:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.406868:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.406884:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.406906:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.406912:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.406920:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.406937:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.406949:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.406958:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407005:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.407907:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.407916:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407927:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.407930:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.407934:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407944:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407952:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407960:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.407976:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836376.407988:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836376.407995:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408003:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.408015:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408024:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408043:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408051:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a4f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408068:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.408071:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408078:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.408081:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408087:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408095:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408102:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a4fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.408118:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.408120:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.408122:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.408869:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.409042:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.409049:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409060:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.409063:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.409067:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409077:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409086:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409092:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409157:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.409841:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.409849:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409870:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.409873:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.409878:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409887:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409896:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.409904:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.409958:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836376.409968:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.409976:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836376.409981:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.409990:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410007:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410014:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410031:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836376.410034:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410039:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836376.410042:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410060:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410071:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410079:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.410081:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836376.410083:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.410157:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836376.410162:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a50b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.410244:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.435175:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.435192:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.435216:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.435223:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.435231:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.435262:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.435274:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.435283:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.435531:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.436047:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.436056:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436068:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.436072:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.436077:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436089:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436098:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436118:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.436159:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836376.436168:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.436177:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836376.436183:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.436193:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.436222:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.436231:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836376.436403:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788836376.436736:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836376.436769:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836376.436775:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436786:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836376.436790:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436798:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436811:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436818:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1b3afae/0xcb5b7bc40b90a519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.436833:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.436835:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.436837:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.439002:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.439022:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.439200:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.439205:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.439212:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.439228:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.439240:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.439248:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.439463:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.439994:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.440001:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.440012:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.440015:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.440020:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.440030:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.440117:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.440124:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440378:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836376.440388:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440398:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.440402:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440413:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440448:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440457:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440474:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.440477:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440483:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.440486:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440504:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440515:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.440524:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.440527:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.440530:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.440540:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836376.440642:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788836376.440648:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a527 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836376.445085:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.445106:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.445129:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.445134:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.445152:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.445169:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.445180:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.445200:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.445486:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836376.445496:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836376.445512:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.445527:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836376.445548:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.445561:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.445697:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.445797:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.445808:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a52e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.445848:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.445851:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.445854:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.447099:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.447111:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.447128:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.447132:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.447138:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.447163:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.447174:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.447182:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.447203:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836376.447213:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.447224:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.447235:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.447241:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.447253:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.447275:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.447284:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a535 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.447316:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.447318:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.447320:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.449131:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.449220:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.449246:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.449250:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.449257:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.449270:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.449283:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.449291:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.449508:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836376.449648:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836376.449664:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.449682:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836376.449687:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.449700:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.449728:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.449756:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021350031/0xcb5b7bc40b90a53c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.449785:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.449787:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.449789:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.450277:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.450287:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.450298:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.450301:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.450306:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.450638:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.450663:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.450670:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.450691:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836376.451011:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.451020:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.451031:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.451037:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.451048:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.451069:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.451077:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.451102:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.451106:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.451108:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.451534:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.451541:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.451553:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.451557:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.451562:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.451573:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.451582:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.451590:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.451622:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836376.452255:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.452262:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.452272:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.452276:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.452280:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.452291:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.452300:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.452307:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.452535:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788836376.452908:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836376.452917:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.452940:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.452944:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.452954:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.452972:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.452980:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a54a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453006:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.453010:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453017:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.453020:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453029:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453040:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453056:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.453083:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.453085:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.453087:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.453180:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.453187:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.453198:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.453207:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.453212:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.453224:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.453235:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.453243:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.453269:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836376.453319:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836376.453334:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.453363:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836376.453368:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.453378:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.453401:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.453408:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.453434:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.453436:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.453437:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.453939:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836376.454201:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836376.454208:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.454222:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788836376.454225:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836376.454230:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.454254:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.454264:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.454280:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836376.454304:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836376.454367:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836376.454378:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.454389:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0cc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836376.454393:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.454401:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.454416:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.454423:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a55f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836376.454442:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.454444:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836376.454445:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836376.455155:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836376.455164:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455177:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1788836376.455182:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836376.455188:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455200:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455208:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455215:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455255:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836376.455296:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.455308:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.455319:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.455324:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.455336:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.455379:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.455388:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027514820/0xcb5b7bc40b90a566 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.455418:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.455421:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.455505:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836376.455732:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836376.455739:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455749:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1788836376.455751:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836376.455756:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455765:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455773:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455780:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.455799:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836376.456159:0:14985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836376.456166:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.456175:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=429s v=(0 0) 00010000:00010000:2.0:1788836376.456187:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836376.456191:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.456200:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.456207:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.456213:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836376.456230:0:14985:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788836376.457214:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836376.457228:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457240:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.457245:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457254:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457277:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457285:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b004b977/0xcb5b7bc40b90a56d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457305:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836376.457309:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457316:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836376.457319:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457326:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457370:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457378:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a574 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836376.457402:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.457404:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836376.457406:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788836376.457652:0:14985:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788836376.457804:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14326:x1875730538524800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 113918us (114064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836376.457816:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788836376.459400:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836376.461245:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14326:1875730538524800:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788836376.461269:0:14326:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788836376.461339:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14326:1875730538524928:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788836376.462022:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836376.462092:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047d67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836376.462214:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538524928 00000100:00100000:3.0:1788836376.462224:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538524928 00000100:00100000:3.0:1788836376.462290:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836376.462302:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14326:x1875730538524928:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788836376.462503:0:14987:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788836376.480214:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14326:x1875730538524928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17902us (18180us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788836376.480238:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836376.480828:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14326:1875730538524928:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788836376.480851:0:14326:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788836377.299656:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836378.324768:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836379.345121:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836380.371638:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788836380.582902:0:15703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788836380.582906:0:15703:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788836380.583020:0:15703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd07af70000 00000020:01000004:0.0:1788836380.583045:0:15703:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788836380.583058:0:15703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788836380.583073:0:15703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd07d3799b8) 00000020:00000080:0.0:1788836380.583088:0:15703:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788836380.643520:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788836380.647288:0:15703:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788836380.655403:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788836380.656074:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788836380.656406:0:15703:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788836380.658389:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 467: rc = 0 00100000:10000000:2.0:1788836380.659194:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 467: rc = 0 00100000:10000000:2.0:1788836380.659306:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 467: rc = 0 00100000:10000000:2.0:1788836380.662831:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 604: rc = 0 00100000:10000000:2.0:1788836380.663548:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 604: rc = 0 00100000:10000000:2.0:1788836380.665554:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 604: rc = 0 00100000:10000000:0.0:1788836380.667527:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 604: rc = 0 00100000:10000000:0.0:1788836380.667835:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 604: rc = 0 00100000:10000000:0.0:1788836380.668804:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 604: rc = 0 00000020:00000080:0.0:1788836380.669488:0:15703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788836380.669500:0:15703:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788836380.669510:0:15703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b90a582 00000020:01000004:0.0:1788836380.669518:0:15703:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788836380.669538:0:15703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788836380.669542:0:15703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788836380.669548:0:15703:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788836380.669571:0:15703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788836380.669574:0:15703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836380.710622:0:15703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836380.710681:0:15703:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788836380.710686:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836380.710688:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836380.710689:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836380.710690:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836380.710692:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836380.710693:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836380.710695:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836380.710697:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836380.710698:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836380.710701:0:15703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788836380.710704:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836380.710705:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836380.710706:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836380.710707:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836380.710715:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836380.710716:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836380.710717:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836380.710718:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836380.710718:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836380.710743:0:15703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836380.710762:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836380.710829:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.711336:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0452d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.721805:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525056 00000100:00100000:0.0:1788836380.721821:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525056 00000100:00100000:0.0:1788836380.721902:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788836380.721913:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:15703:x1875730538525056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836380.721968:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788836380.721972:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788836380.721975:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788836380.754568:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:15703:x1875730538525056:12345-0@lo:253:mount.lustre.0 Request processed in 32649us (43730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836380.754584:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836380.754706:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836380.754721:0:15703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836380.754726:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836380.754727:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836380.754729:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836380.754730:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836380.754731:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836380.754733:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836380.754735:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836380.754736:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836380.754737:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836380.754757:0:15703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd07af70000 from lustre-OST0001 10000000:01000000:3.0:1788836380.754784:0:15703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788836380.754787:0:15703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788836380.754794:0:15703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd07b2b19b8 local copy 00010000:00010000:3.0:1788836380.754805:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836380.755264:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836380.755299:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.755339:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.755530:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525184 00000100:00100000:0.0:1788836380.755537:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525184 00000100:00100000:0.0:1788836380.755578:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836380.755594:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:15703:x1875730538525184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836380.755761:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:15703:x1875730538525184:12345-0@lo:501:mount.lustre.0 Request processed in 168us (460us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836380.755770:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836380.756005:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788836380.756019:0:15703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788836380.756211:0:15703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788836380.756223:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.756231:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0c600/0xcb5b7bc40b90a328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a32f expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836380.756249:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd07af70000 10000000:01000000:2.0:1788836380.756254:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788836380.756259:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788836380.756262:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836380.756266:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788836380.756270:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788836380.756292:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.756300:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.756309:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836380.756323:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836380.756377:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.756397:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.756537:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525312 00000100:00100000:0.0:1788836380.756542:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525312 00000100:00100000:0.0:1788836380.756645:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836380.756663:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:15703:x1875730538525312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836380.756674:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836380.756686:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90a590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a589 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.756706:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90a590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a589 expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.756717:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217cc00/0xcb5b7bc40b90a590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a589 expref: 17 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.756727:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217cc00, rc 0) 00000100:00100000:0.0:1788836380.756764:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525312:12345-0@lo:101:mount.lustre.0 Request processed in 112us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.756771:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788836380.756831:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836380.756853:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.756863:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836380.758367:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788836380.764565:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836380.764812:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788836380.764863:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788836380.765229:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788836380.765280:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788836380.765319:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788836380.765388:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788836380.765474:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788836380.765483:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788836380.765572:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836380.765632:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.765678:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836380.765777:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525440 00000100:00100000:3.0:1788836380.765784:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525440 00000100:00100000:3.0:1788836380.765819:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788836380.765835:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836380.766207:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525440:12345-0@lo:501:mount.lustre.0 Request processed in 372us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836380.766215:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836380.766647:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836380.766696:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836380.766738:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.766758:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836380.766975:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525568 00000100:00100000:3.0:1788836380.767041:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525568 00000100:00100000:3.0:1788836380.767080:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788836380.767087:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836380.767428:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525568:12345-0@lo:503:mount.lustre.0 Request processed in 341us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836380.767436:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836380.770584:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836380.772041:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836380.772132:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836380.772211:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.772299:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.775106:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525696 00000100:00100000:0.0:1788836380.775130:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525696 00000100:00100000:0.0:1788836380.775190:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788836380.775200:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836380.775515:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525696:12345-0@lo:502:mount.lustre.0 Request processed in 316us (3303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.775532:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836380.776016:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836380.776312:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788836380.776395:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788836380.776425:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788836380.776467:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788836380.776497:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788836380.776525:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788836380.776577:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788836380.776607:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788836380.776646:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788836380.776695:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836380.776744:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.776784:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd079ea19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836380.777028:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525824 00000100:00100000:2.0:1788836380.777035:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525824 00000100:00100000:2.0:1788836380.777065:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836380.777073:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836380.777236:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525824:12345-0@lo:502:mount.lustre.0 Request processed in 163us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836380.777244:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836380.778447:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836380.778549:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788836380.778561:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788836380.780499:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836380.780509:0:15705:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788836380.780515:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.780517:0:15705:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788836380.780522:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836380.780535:0:15705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd0482ccd28) 00000020:00000080:3.0:1788836380.780554:0:15705:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788836380.780559:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788836380.780609:0:15705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd07af70000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788836380.780616:0:15705:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836380.780622:0:15705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcb5b7bc40b90a59e 00010000:00010000:3.0:1788836380.783635:0:15705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788836380.784003:0:15705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788836380.798810:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788836380.814600:0:15705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788836380.814613:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836380.814618:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836380.814620:0:15705:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788836380.814625:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836380.814628:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836380.814635:0:15705:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836380.814639:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836380.814641:0:15705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836380.814643:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836380.814645:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836380.814647:0:15705:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788836380.814649:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836380.814652:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836380.814653:0:15705:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836380.814656:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788836380.814713:0:15705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836380.814716:0:15705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836380.814717:0:15705:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836380.814720:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788836380.814862:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788836380.814895:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788836380.814916:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.814927:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998e00/0xcb5b7bc40b90a589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a590 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836380.814934:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd07af70000 from 1 10000000:01000000:3.0:1788836380.814937:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836380.814969:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.814985:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.814996:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836380.815018:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836380.815079:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.815111:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836380.816988:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538525952 00000100:00100000:2.0:1788836380.816998:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538525952 00000100:00100000:2.0:1788836380.817045:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836380.817053:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:15703:x1875730538525952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836380.817067:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836380.817083:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a5a5 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.817107:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.817128:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.817137:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998400, rc 0) 00000100:00100000:2.0:1788836380.817199:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538525952:12345-0@lo:101:mount.lustre.0 Request processed in 146us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836380.817206:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836380.817260:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538525952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836380.817275:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.817284:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836380.817760:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788836380.818033:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836380.826660:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788836380.826747:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788836380.826827:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788836380.826834:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788836380.826941:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836380.826998:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.827035:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836380.828003:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526080 00000100:00100000:1.0:1788836380.828013:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526080 00000100:00100000:1.0:1788836380.828052:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836380.828061:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836380.828308:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526080:12345-0@lo:501:mount.lustre.0 Request processed in 246us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836380.828316:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836380.828382:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836380.828419:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836380.828488:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836380.828509:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.828617:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526208 00000100:00100000:0.0:1788836380.828621:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526208 00000100:00100000:0.0:1788836380.828649:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788836380.828657:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836380.828800:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526208:12345-0@lo:503:mount.lustre.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.828807:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836380.828896:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836380.829406:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836380.829462:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836380.829500:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.829519:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.829630:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526336 00000100:00100000:0.0:1788836380.829635:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526336 00000100:00100000:0.0:1788836380.829658:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836380.829663:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836380.829807:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526336:12345-0@lo:502:mount.lustre.0 Request processed in 143us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.829814:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836380.830937:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836380.831232:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788836380.831290:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788836380.831394:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788836380.831436:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788836380.831486:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788836380.831537:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788836380.831572:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788836380.831603:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788836380.831641:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836380.831700:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.831732:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e74180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.831955:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526464 00000100:00100000:0.0:1788836380.831962:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526464 00000100:00100000:0.0:1788836380.832001:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788836380.832008:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836380.832187:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526464:12345-0@lo:502:mount.lustre.0 Request processed in 179us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.832195:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836380.834042:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836380.834220:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788836380.834234:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788836380.850094:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836380.850107:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850110:0:15709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788836380.850126:0:15709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd07af70000 00000020:00000080:3.0:1788836380.850129:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836380.850136:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836380.850138:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850139:0:15709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788836380.850142:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836380.850144:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850145:0:15709:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788836380.850148:0:15709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd07af70000 00000020:00000080:3.0:1788836380.850150:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836380.850208:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836380.850211:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850213:0:15709:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788836380.850215:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788836380.850218:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850219:0:15709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788836380.850222:0:15709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd07af70000 00000020:00000080:3.0:1788836380.850225:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788836380.850259:0:15709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836380.850262:0:15709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836380.850264:0:15709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788836380.850267:0:15709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788836380.850446:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788836380.850468:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836380.850482:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.850494:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836380.850536:0:15703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836380.850539:0:15703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd07af70000 10000000:01000000:2.0:1788836380.850542:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd07af70000 10000000:01000000:2.0:1788836380.850546:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836380.850551:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd07af70000 from 1 10000000:01000000:2.0:1788836380.850554:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836380.850588:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.850597:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.850608:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836380.850633:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836380.850694:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.850750:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836380.850801:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526592 00000100:00100000:3.0:1788836380.850808:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526592 00000100:00100000:3.0:1788836380.851459:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836380.851472:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538526592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836380.851493:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836380.851507:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90a5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a5b3 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.851530:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90a5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5b3 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.851541:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd042c0c200/0xcb5b7bc40b90a5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5b3 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.851549:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd042c0c200, rc 0) 00000100:00100000:3.0:1788836380.851593:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526592:12345-0@lo:101:mount.lustre.0 Request processed in 125us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836380.851601:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788836380.851685:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836380.851700:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.851721:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836380.852374:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788836380.852893:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836380.853196:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788836380.853241:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788836380.853277:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788836380.853325:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788836380.853389:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788836380.853439:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788836380.853477:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788836380.853512:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788836380.853577:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788836380.853615:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788836380.853649:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788836380.853697:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788836380.853735:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788836380.853771:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788836380.853819:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788836380.853858:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788836380.853893:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788836380.853943:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788836380.853980:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788836380.854015:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788836380.854064:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788836380.854101:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788836380.854152:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788836380.854217:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788836380.854268:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788836380.854304:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788836380.854391:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788836380.854431:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788836380.854466:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788836380.854532:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788836380.854571:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788836380.854605:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788836380.854635:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788836380.854681:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788836380.854717:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788836380.854765:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788836380.854798:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788836380.854882:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788836380.854890:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788836380.854971:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836380.855028:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836380.864217:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bc8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788836380.864301:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526720 00000100:00100000:2.0:1788836380.864310:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526720 00000100:00100000:2.0:1788836380.864374:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836380.864383:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836380.871418:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526720:12345-0@lo:501:mount.lustre.0 Request processed in 7029us (16382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836380.871432:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836380.871796:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836380.873031:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836380.873097:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.873143:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526848 00000100:00100000:2.0:1788836380.873149:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526848 00000100:00100000:2.0:1788836380.873187:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836380.873194:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836380.873370:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079314850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526848:12345-0@lo:503:mount.lustre.0 Request processed in 176us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836380.873378:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836380.873423:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836380.873439:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788836380.882910:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788836380.883006:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836380.883088:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.883133:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd050a9a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.885199:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538526976 00000100:00100000:0.0:1788836380.885213:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538526976 00000100:00100000:0.0:1788836380.885274:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836380.885284:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836380.885583:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079316050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538526976:12345-0@lo:502:mount.lustre.0 Request processed in 299us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.885591:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836380.889701:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538526976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836380.890022:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788836380.890083:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788836380.890133:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788836380.890184:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788836380.890220:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788836380.890298:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788836380.890337:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788836380.890408:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788836380.890454:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788836380.890491:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788836380.890529:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788836380.890578:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788836380.890611:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788836380.890644:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788836380.890692:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788836380.890730:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788836380.890764:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788836380.890809:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788836380.890846:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788836380.890880:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788836380.890928:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788836380.890978:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788836380.891014:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788836380.891059:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788836380.891095:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788836380.891144:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788836380.891196:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788836380.891233:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788836380.891268:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788836380.891317:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788836380.891380:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788836380.891417:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788836380.891465:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788836380.891515:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788836380.891553:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788836380.891601:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788836380.891637:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788836380.891688:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788836380.891739:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788836380.891777:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788836380.891823:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538527104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836380.891913:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.891958:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd054bc8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836380.892526:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527104 00000100:00100000:0.0:1788836380.892534:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527104 00000100:00100000:0.0:1788836380.892583:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836380.892593:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538527104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836380.892829:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538527104:12345-0@lo:502:mount.lustre.0 Request processed in 236us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.892845:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788836380.896909:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538527104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836380.897053:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788836380.897069:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788836380.898260:0:15714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788836380.898275:0:15714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd0482c8000) 00000020:00000080:3.0:1788836380.898296:0:15714:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788836380.898409:0:15714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd07af70000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788836380.898415:0:15714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd07af70000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788836380.898417:0:15714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd07af70000 3 00010000:00080000:3.0:1788836380.898457:0:15714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bcf479b2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788836380.900076:0:15714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788836380.900262:0:15714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788836380.900295:0:15714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836380.900311:0:15714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcb5b7bc40b90a5c8 00000100:00080000:3.0:1788836380.900321:0:15714:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836380.900333:0:15714:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bcf479b2000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788836380.900391:0:15714:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bcf45e66680 x1875730538527232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836380.900418:0:15714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788836380.900550:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836380.900555:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788836380.900557:0:38:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836380.900562:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1788836380.900566:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788836380.900570:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd078fef800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788836380.900584:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07af27b80 x1875730538527488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836380.900625:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836380.900639:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538527360:0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.900700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836380.900742:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538527616:0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.900767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836380.900785:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836380.900790:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538527744:0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.900810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836380.900840:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527360 00000100:00100000:0.0:1788836380.900846:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527360 00000100:00100000:0.0:1788836380.900909:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836380.900919:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538527360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.900968:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875730538527360:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.900975:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836380.900997:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527616 00000100:00100000:0.0:1788836380.901007:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527616 00000100:00100000:0.0:1788836380.901032:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527744 00000100:00100000:0.0:1788836380.901035:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527744 00000100:00100000:0.0:1788836380.901050:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836380.901056:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538527616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.901093:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875730538527616:12345-0@lo:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.901099:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836380.901110:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836380.901132:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538527744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.901161:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875730538527744:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.901166:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788836380.901185:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836380.901189:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788836380.901218:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07af24380 x1875730538527744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836380.901231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1875730538527744:0@lo:400:kworker.0 00010000:00080000:0.0:1788836380.901241:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd07af27480 x1875730538527616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836380.901249:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875730538527616:0@lo:400:kworker.0 00000100:00100000:0.0:1788836380.901411:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538527360:0@lo:400:kworker.0 00000100:00100000:2.0:1788836380.906840:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538527232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836380.906933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.906980:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538527488:0@lo:8:kworker.0 00000100:00100000:2.0:1788836380.907005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836380.907057:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527488 00000100:00100000:2.0:1788836380.907063:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527488 00000100:00100000:2.0:1788836380.907097:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836380.907104:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875730538527488:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788836380.907172:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1875730538527488:12345-0@lo:8:kworker.0 Request processed in 66us (165us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788836380.907179:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836380.907212:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836380.907219:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836380.907223:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788836380.907226:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538527488:0@lo:8:kworker.0 00000100:00100000:0.0:1788836380.910367:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527232 00000100:00100000:0.0:1788836380.910379:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527232 00000100:00100000:0.0:1788836380.910421:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836380.910428:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1875730538527232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788836380.910471:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1788836380.910501:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcb5b7bc40b90a5cf 00000004:00100000:0.0:1788836380.910516:0:14304:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788836380.910544:0:14304:0:(import.c:65:import_set_state_nolock()) ffff9bcf45113800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836380.910616:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875730538527232:12345-0@lo:38:llog_process_th.0 Request processed in 188us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836380.910624:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1788836380.912486:0:15714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788836380.912715:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788836380.912742:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836380.912764:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.912775:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047998a00/0xcb5b7bc40b90a5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5ba expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788836380.912825:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788836380.912828:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836380.912829:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836380.912830:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836380.912831:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836380.912832:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836380.912834:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836380.912836:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836380.912837:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836380.912841:0:15703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788836380.912843:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836380.912844:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836380.912846:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836380.912847:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836380.912848:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836380.912848:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836380.912850:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836380.912851:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836380.912857:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836380.913329:0:15703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788836380.913391:0:15703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538527872:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788836380.913454:0:15703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836380.913493:0:15703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0479c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836380.913710:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538527872 00000100:00100000:1.0:1788836380.913717:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538527872 00000100:00100000:1.0:1788836380.913853:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836380.913862:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:15703:x1875730538527872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836380.913893:0:14297:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788836380.913905:0:14297:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788836380.916446:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bcf45e66680 x1875730538527232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836380.916461:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788836380.916470:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788836380.916478:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788836380.916484:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788836380.916487:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bcf479b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788836380.916494:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1875730538527232:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788836380.935514:0:14297:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836380.935536:0:14297:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788836380.935629:0:14319:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788836380.935635:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788836380.935669:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.935687:0:14319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.935696:0:14319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.935734:0:14319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.935748:0:14319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 19 pid: 14297 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836380.935761:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538528000:0@lo:104: 00000100:00100000:2.0:1788836380.935826:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836380.935871:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528000 00000100:00100000:3.0:1788836380.935879:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528000 00000100:00100000:2.0:1788836380.935882:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd05851c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788836380.935918:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836380.935927:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538528000:12345-0@lo:104: 00000100:00100000:2.0:1788836380.935931:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788836380.935938:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788836380.935939:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836380.935999:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836380.936005:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:14319:x1875730538528000:12345-0@lo:104: Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836380.936012:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788836380.936152:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836380.936160:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.936169:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1788836380.936174:0:14291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.936182:0:14291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836380.936191:0:14291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836380.936197:0:14291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788836380.936229:0:14291:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.936236:0:14291:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836380.936258:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.936265:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a4a9 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836380.936291:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836380.936293:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836380.936295:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836380.936307:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538528128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836380.936337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836380.936427:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528128 00000100:00100000:1.0:1788836380.936432:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528128 00010000:00010000:1.0:1788836380.936455:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 20 pid: 14297 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836380.936487:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836380.936495:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+20:3304:x1875730538528128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836380.936506:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836380.936512:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 20 pid: 14297 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936523:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 20 pid: 14297 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936539:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936548:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788836380.936561:0:14290:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001282511s 00010000:00010000:1.0:1788836380.936565:0:14290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936573:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936580:0:14290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936598:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936604:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836380.936609:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936616:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936627:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836380.936636:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836380.936680:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+20:3304:x1875730538528128:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836380.936687:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788836380.936793:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217dc00/0xcb5b7bc40b90a4a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a4a2 expref: 19 pid: 14297 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836380.936804:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14319:1875730538528000:0@lo:104: 00010000:00010000:2.0:1788836380.936821:0:14319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.936828:0:14319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.936834:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836380.936846:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999e00/0xcb5b7bc40b90a5d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836380.937160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538528128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836380.947532:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:15703:x1875730538527872:12345-0@lo:253:mount.lustre.0 Request processed in 33663us (34069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836380.947564:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836380.948180:0:15703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e8cc5c45-b703-4cf0-83fd-6722cde04691:15703:1875730538527872:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788836380.948196:0:15703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788836380.948200:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836380.948201:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788836380.948203:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836380.948204:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836380.948205:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836380.948206:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836380.948208:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836380.948209:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836380.948211:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788836380.948226:0:15703:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788836380.955375:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836380.955516:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836380.955646:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836380.955770:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788836380.955887:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788836380.956070:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788836380.959368:0:15703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788836381.024959:0:15703:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788836381.024966:0:15703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788836381.024995:0:15703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836381.025048:0:15703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836381.025060:0:15703:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788836381.025085:0:15703:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:0.0:1788836381.158668:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788836381.158725:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788836381.392656:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836381.520624:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538528256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836381.520692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836381.520853:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528256 00000100:00100000:3.0:1788836381.520860:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528256 00000100:00100000:3.0:1788836381.520919:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836381.520927:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538528256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836381.520959:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836381.523255:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538528256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2321us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836381.523255:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788836381.523266:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836381.523285:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538528256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788836382.416524:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788836382.547440:0:14300:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836382.547448:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bcf45ede000 from 8 10000000:01000000:1.0:1788836382.547453:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836382.547504:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.547516:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.547546:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836382.547572:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538528384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836382.547639:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836382.547697:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0496b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.547759:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528384 00000100:00100000:2.0:1788836382.547767:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528384 00000100:00100000:2.0:1788836382.547820:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836382.547828:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538528384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836382.547840:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836382.547852:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047999800/0xcb5b7bc40b90a5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a5dd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.547886:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999800/0xcb5b7bc40b90a5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5dd expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.547896:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047999800/0xcb5b7bc40b90a5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5dd expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836382.547904:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999800, rc 0) 00000100:00100000:2.0:1788836382.547953:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538528384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.547960:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836382.547984:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538528384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836382.548002:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836382.548011:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836382.548081:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538528512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836382.548127:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836382.548149:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836382.548226:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528512 00000100:00100000:2.0:1788836382.548231:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528512 00000100:00100000:2.0:1788836382.548262:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836382.548268:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538528512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788836382.548281:0:14297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836382.548297:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836382.548303:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788836382.548405:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538528512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836382.548411:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836382.548511:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538528512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788836382.548569:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788836382.548576:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836382.548584:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07978b000/0xcb5b7bc40b90a5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a5e4 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836383.443533:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836383.889306:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836384.464770:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836385.498183:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836386.128934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836386.128943:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836386.128947:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836386.128962:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd078fef800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788836386.128989:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd07a3df800 x1875730538528896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836386.129150:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538528640:0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.129234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.129289:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538529280:0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.129483:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.129518:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836386.129524:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538528768:0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.129553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.129589:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538528896:0@lo:8:kworker.0 00000100:00100000:2.0:1788836386.129613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.129644:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538529024:0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.129668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.129688:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836386.129693:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538529152:0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.129725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836386.129952:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529280 00000100:00100000:0.0:1788836386.129963:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529280 00000100:00100000:2.0:1788836386.129984:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528640 00000100:00100000:2.0:1788836386.130004:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528640 00000100:00100000:0.0:1788836386.130017:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529024 00000100:00100000:0.0:1788836386.130020:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529024 00000100:00100000:0.0:1788836386.130031:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529152 00000100:00100000:0.0:1788836386.130033:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529152 00000100:00100000:2.0:1788836386.130111:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788836386.130121:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd050a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538528640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.130178:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd050a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538528640:12345-0@lo:400:kworker.0 Request processed in 58us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836386.130187:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788836386.130203:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538528640:0@lo:400:kworker.0 00000100:00100000:0.0:1788836386.130303:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836386.130313:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538529280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836386.130393:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538529280:12345-0@lo:400:kworker.0 Request processed in 81us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836386.130399:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836386.130421:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836386.130427:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538529024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836386.130462:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538529024:12345-0@lo:400:kworker.0 Request processed in 35us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836386.130468:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836386.130481:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836386.130486:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538529152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836386.130515:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538529152:12345-0@lo:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836386.130531:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788836386.130596:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836386.131075:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a3ddf80 x1875730538529280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836386.131099:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538529280:0@lo:400:kworker.0 00000100:00100000:3.0:1788836386.131335:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528768 00000100:00100000:3.0:1788836386.131365:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528768 00000100:00100000:2.0:1788836386.131545:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538528896 00000100:00100000:2.0:1788836386.131550:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538528896 00000100:00100000:2.0:1788836386.131567:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836386.131577:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538528768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836386.131634:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538528768:12345-0@lo:400:kworker.0 Request processed in 60us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836386.131641:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836386.131654:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836386.131659:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1875730538528896:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788836386.131688:0:14985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788836386.131724:0:14985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcb5b7bc40b90a5eb 00002000:00100000:2.0:1788836386.131743:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bcf46075000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788836386.131747:0:14985:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788836386.131751:0:14985:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788836386.133010:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788836386.134259:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836386.135503:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9bcf46077000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836386.135637:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875730538528896:12345-0@lo:8:kworker.0 Request processed in 3972us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836386.135649:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788836386.137242:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a3de300 x1875730538529152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836386.137265:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538529152:0@lo:400:kworker.0 00010000:00080000:3.0:1788836386.137281:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a3dc380 x1875730538529024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836386.137289:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538529024:0@lo:400:kworker.0 00010000:00080000:2.0:1788836386.140589:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07a3df800 x1875730538528896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836386.140625:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788836386.140638:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788836386.140646:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788836386.140650:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9bd078fef800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788836386.140664:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788836386.140672:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1875730538528896:0@lo:8:kworker.0 00000100:00100000:2.0:1788836386.140726:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538528768:0@lo:400:kworker.0 00000004:00080000:0.0:1788836386.140726:0:14328:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788836386.140741:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836386.141252:0:14328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14328:1875730538529536:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788836386.142512:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538529408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836386.142609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.142695:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529408 00000100:00100000:2.0:1788836386.142704:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529408 00000100:00100000:2.0:1788836386.142775:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836386.142786:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538529408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836386.142831:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836386.142886:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538529408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836386.142895:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788836386.142918:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788836386.142953:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd07af27480 x1875730538529408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836386.142976:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538529408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836386.146705:0:14328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836386.146750:0:14328:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd0587de780 going to sleep for 11 seconds 00000004:00080000:0.0:1788836386.147265:0:14327:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836386.147817:0:14327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439282472539ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788836386.148326:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529536 00000100:00100000:3.0:1788836386.148340:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529536 00000100:00100000:2.0:1788836386.149570:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836386.149590:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14328:x1875730538529536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788836386.161586:0:14987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788836386.161600:0:14987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788836386.161607:0:14987:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1788836386.176779:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836386.176790:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.176806:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788836386.176810:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836386.176816:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.176833:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.176853:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.176861:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177193:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836386.177209:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836386.177216:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177224:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836386.177236:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177245:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177263:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177270:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d302ef2d/0xcb5b7bc40b90a5f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.177287:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.177288:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.177290:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836386.178407:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836386.178417:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.178431:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788836386.178436:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836386.178442:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.178455:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.178465:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.178480:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.178495:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836386.179533:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836386.179543:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.179556:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788836386.179560:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836386.180199:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836386.180213:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.180227:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836386.180232:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.180245:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.180278:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.180286:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d720ea/0xcb5b7bc40b90a5f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.180332:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.180334:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.180336:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.183634:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.183656:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.183668:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.183676:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184317:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836386.184333:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836386.184339:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184407:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047999a00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836386.184413:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184423:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184443:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184452:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2cf343d/0xcb5b7bc40b90a600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.184474:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.184477:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.184479:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.192101:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.192115:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192131:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.192136:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.192141:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192156:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192166:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192173:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192207:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.192220:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.192226:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192247:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0ce00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.192252:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192262:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192280:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192289:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c97b7e3/0xcb5b7bc40b90a607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192316:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.192318:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.192321:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.192895:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.192902:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192912:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.192921:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.192925:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192935:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192943:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192950:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.192973:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836386.193399:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.193405:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193413:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.193416:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.193420:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193429:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193437:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193450:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193464:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836386.193474:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836386.193478:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193485:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0c000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.193489:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193497:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193510:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193517:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81ca147/0xcb5b7bc40b90a60e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193530:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.193533:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193551:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.193554:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193562:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193571:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193578:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e03d6c/0xcb5b7bc40b90a615 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.193590:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.193592:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.193594:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.194069:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788836386.194481:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.195540:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.195559:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.195614:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.195621:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.195635:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.195654:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.195661:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.196517:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836386.196721:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836386.196736:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.196752:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0d600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836386.196757:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.196769:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.196796:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.196806:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3148e9d/0xcb5b7bc40b90a61c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.197273:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.197276:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.197278:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.198141:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.198152:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198168:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.198172:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.198177:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198190:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198200:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198208:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198248:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836386.198709:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.198715:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198724:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.198727:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.198731:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198740:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198748:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198755:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198773:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836386.198787:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836386.198794:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198801:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0cc00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.198811:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.198821:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199060:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199070:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11fb6a2/0xcb5b7bc40b90a623 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199098:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.199102:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199109:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.199112:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199120:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199130:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199137:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a62a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.199155:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.199157:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.199158:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.200140:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.200149:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200160:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.200164:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.200168:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200178:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200187:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200194:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200213:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.200223:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.200227:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200243:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.200246:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200253:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200265:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200272:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a631 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.200286:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.200288:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.200290:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.200872:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.203040:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.203052:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203068:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.203072:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.203487:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203504:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203522:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203530:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203552:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.203732:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.203739:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203748:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.203753:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203763:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203783:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203792:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a638 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.203813:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.203824:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.203826:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.209337:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.209367:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209385:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.209390:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.209396:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209411:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209422:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209430:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209453:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836386.209915:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.209921:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209931:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.209934:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.209939:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209955:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209963:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209971:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.209987:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836386.210000:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836386.210006:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210014:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.210018:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210027:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210042:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210050:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a63f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210072:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.210088:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210095:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.210098:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210106:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210116:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210122:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021350031/0xcb5b7bc40b90a646 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210132:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.210134:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.210136:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.210445:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.210559:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.210566:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210575:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.210583:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.210588:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210598:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210607:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210614:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210631:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.210642:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.210645:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210652:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.210655:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210662:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210672:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210690:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a64d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.210704:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.210706:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.210707:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.213783:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.213797:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.213813:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.213818:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.213824:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.214301:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.214315:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.214322:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.214337:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788836386.215244:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.215257:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215268:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.215271:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.215276:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215288:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215297:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215304:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215325:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788836386.215337:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836386.215362:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215370:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.215374:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.215382:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.215512:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.217522:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.217538:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76d3dcb/0xcb5b7bc40b90a654 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.217577:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.217580:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.217582:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.218218:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.218227:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218239:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.218243:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.218248:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218260:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218269:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218276:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218307:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.218319:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.218323:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218331:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.218335:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218382:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218396:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218403:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879a7f2c/0xcb5b7bc40b90a662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218418:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.218420:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.218421:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.218844:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.218851:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218860:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.218869:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.218874:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218884:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218892:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218898:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218913:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.218922:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.218926:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218932:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.218937:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218944:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218957:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218976:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a669 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.218994:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.218996:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.218997:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.219439:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.219446:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219454:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.219458:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.219463:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219473:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219482:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219490:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219504:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.219513:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.219524:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219531:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.219535:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219543:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219555:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219562:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a670 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219575:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.219577:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.219579:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.219969:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.219975:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.219984:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.219987:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.219991:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220011:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220018:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220025:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220038:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.220046:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.220049:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220055:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.220057:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220064:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.220073:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.224512:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a677 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.224934:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.224937:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.224940:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.226191:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.226202:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.226217:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.226222:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.226229:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.226242:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.226252:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.226260:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.226365:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836386.226491:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836386.226499:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.226510:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836386.226515:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.226537:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.226557:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.228769:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a67e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.229699:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.229706:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.229712:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.230381:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.230520:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.230537:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.230542:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.230549:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.230628:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.230642:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.230652:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.230677:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.231987:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.231998:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.232010:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.232015:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.232025:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.232060:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.232066:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a685 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.232099:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.232101:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.232103:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239009:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239024:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.239039:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.239043:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.239054:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.239075:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.239092:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a65b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.239127:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239129:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239133:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239141:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.239144:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.240309:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.240322:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240336:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.240545:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.240554:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240626:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240638:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240646:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240666:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.240681:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.240754:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240771:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031c00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.240775:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240784:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240801:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240808:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8f7b31/0xcb5b7bc40b90a68c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.240825:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.240827:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.240829:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.241547:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.241554:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241811:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.241815:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.241821:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241834:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241851:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241859:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241878:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.241889:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.241894:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241901:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.241905:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241913:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241928:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241935:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e05003/0xcb5b7bc40b90a693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.241960:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.241971:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.241973:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788836386.244971:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788836386.245143:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.245153:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.245171:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.245177:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.245184:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.245200:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.245211:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.245218:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.245237:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836386.245247:0:16002:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836386.245256:0:16002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.245267:0:16002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031800 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836386.245272:0:16002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.245283:0:16002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.245301:0:16002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.245309:0:16002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a948e1/0xcb5b7bc40b90a69a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836386.245406:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.245408:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836386.245410:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.248848:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.248861:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248879:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.248883:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.248898:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248914:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248924:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248934:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248956:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836386.248972:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836386.248979:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.248986:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836386.248992:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249001:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249017:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249034:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee0e1db7/0xcb5b7bc40b90a6a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249056:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.249058:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836386.249061:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836386.249615:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788836386.249622:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249632:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788836386.249635:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836386.249640:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249650:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249659:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249666:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836386.249679:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836386.249874:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836386.249888:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.249903:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040031400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836386.249909:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.249920:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.249945:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.249956:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015eb368c/0xcb5b7bc40b90a6a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836386.249992:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.249995:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836386.250001:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788836386.250135:0:14987:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788836386.250246:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14328:x1875730538529536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100651us (103539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836386.250256:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836386.250415:0:14328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14328:1875730538529536:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788836386.250448:0:14328:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788836386.250515:0:14328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14328:1875730538529664:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788836386.250579:0:14328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836386.250646:0:14328:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07965b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836386.250931:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529664 00000100:00100000:2.0:1788836386.250942:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529664 00000100:00100000:2.0:1788836386.250998:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836386.251008:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14328:x1875730538529664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788836386.251132:0:14985:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788836386.261639:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14328:x1875730538529664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10624us (11052us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788836386.261655:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836386.261952:0:14328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14328:1875730538529664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788836386.261969:0:14328:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1788836386.269608:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788836386.513537:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836386.642451:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538529792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836386.642523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836386.643173:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529792 00000100:00100000:2.0:1788836386.643191:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529792 00000100:00100000:2.0:1788836386.643334:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836386.643733:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538529792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836386.643771:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836386.643899:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538529792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 557us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836386.643907:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836386.650533:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538529792:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788836387.289689:0:16064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788836387.536573:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836388.564908:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836389.359663:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.359808:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613504 00000100:00100000:2.0:1788836389.359829:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613504 00000100:00100000:2.0:1788836389.359877:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788836389.359886:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875730518613504:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788836389.359916:0:14296:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 33da8487-9547-4be0-bbdf-a73d9371b5ba@192.168.203.52@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788836389.359945:0:14296:0:(genops.c:1385:class_connect()) connect: client 33da8487-9547-4be0-bbdf-a73d9371b5ba, cookie 0xcb5b7bc40b90a6af 00000100:00080000:2.0:1788836389.360108:0:14296:0:(import.c:65:import_set_state_nolock()) ffff9bcf46073800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836389.360199:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+5:2352:x1875730518613504:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 311us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.360207:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788836389.367577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.367780:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613632 00000100:00100000:2.0:1788836389.367790:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613632 00000100:00100000:2.0:1788836389.367849:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1788836389.367869:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+5:13761:x1875730518613632:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836389.367886:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836389.367905:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998200/0xcb5b7bc40b90a6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316aabc expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.367931:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998200/0xcb5b7bc40b90a6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aabc expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.367943:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998200/0xcb5b7bc40b90a6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aabc expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.367952:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998200, rc 0) 00000100:00100000:2.0:1788836389.368009:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+6:13761:x1875730518613632:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 151us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.368016:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1788836389.371009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836389.371114:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613760 00000100:00100000:1.0:1788836389.371125:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613760 00000100:00100000:1.0:1788836389.371190:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1788836389.371201:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+6:13761:x1875730518613760:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788836389.371542:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+6:13761:x1875730518613760:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 341us (539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788836389.371550:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1788836389.375779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.376283:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518613888 00000100:00100000:2.0:1788836389.376294:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518613888 00000100:00100000:2.0:1788836389.376387:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788836389.376398:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+6:13761:x1875730518613888:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836389.376414:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836389.376444:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047999a00/0xcb5b7bc40b90a6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316aac3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.376472:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999a00/0xcb5b7bc40b90a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aac3 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.376484:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047999a00/0xcb5b7bc40b90a6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aac3 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.376494:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999a00, rc 0) 00000100:00100000:2.0:1788836389.377497:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+7:13761:x1875730518613888:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 1094us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.377506:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788836389.379795:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836389.380504:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614016 00000100:00100000:1.0:1788836389.380516:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614016 00000100:00100000:1.0:1788836389.380627:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788836389.380639:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+7:13761:x1875730518614016:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788836389.380966:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13761:x1875730518614016:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 328us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836389.380974:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788836389.383505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.383679:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614144 00000100:00100000:2.0:1788836389.383689:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614144 00000100:00100000:2.0:1788836389.383850:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1788836389.383861:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf452c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13761:x1875730518614144:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836389.384403:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf452c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13761:x1875730518614144:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 542us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.384412:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1788836389.387822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836389.388265:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614272 00000100:00100000:1.0:1788836389.388275:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614272 00000100:00100000:1.0:1788836389.388504:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1788836389.388515:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13780:x1875730518614272:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836389.388870:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13780:x1875730518614272:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 356us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836389.388878:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788836389.396679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.396787:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614400 00000100:00100000:2.0:1788836389.396798:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614400 00000100:00100000:2.0:1788836389.396851:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1788836389.396870:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13780:x1875730518614400:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836389.397498:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13780:x1875730518614400:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 636us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.397519:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1788836389.409133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836389.409300:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614528 00000100:00100000:1.0:1788836389.409309:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614528 00000100:00100000:1.0:1788836389.409513:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1788836389.409522:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+8:13761:x1875730518614528:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836389.409538:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836389.409554:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd07978bc00/0xcb5b7bc40b90a6c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316aaed expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836389.409581:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd07978bc00/0xcb5b7bc40b90a6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaed expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836389.409593:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd07978bc00/0xcb5b7bc40b90a6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaed expref: 9 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836389.409620:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978bc00, rc 0) 00000100:00100000:1.0:1788836389.410012:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+9:13761:x1875730518614528:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 490us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836389.410019:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:3.0:1788836389.423016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.423187:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614656 00000100:00100000:2.0:1788836389.423197:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614656 00000100:00100000:2.0:1788836389.423250:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:2.0:1788836389.423261:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+9:13761:x1875730518614656:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788836389.423285:0:14297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788836389.423307:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788836389.423311:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788836389.423314:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788836389.423317:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788836389.425684:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+9:13761:x1875730518614656:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 2414us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.425698:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788836389.431195:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.431295:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614784 00000100:00100000:2.0:1788836389.431305:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614784 00000100:00100000:3.0:1788836389.431427:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1788836389.431439:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+9:13761:x1875730518614784:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836389.431457:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836389.431474:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316aaf4 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836389.431503:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 10 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836389.431514:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 10 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836389.431541:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030600, rc 0) 00000100:00100000:3.0:1788836389.431672:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13761:x1875730518614784:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 236us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836389.431679:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788836389.433401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.433467:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518614912 00000100:00100000:2.0:1788836389.433477:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518614912 00000100:00100000:2.0:1788836389.433581:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1788836389.433591:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13761:x1875730518614912:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836389.434131:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13761:x1875730518614912:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 540us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.434140:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788836389.436975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836389.437128:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615040 00000100:00100000:3.0:1788836389.437138:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615040 00000100:00100000:3.0:1788836389.437243:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1788836389.437254:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13761:x1875730518615040:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788836389.437699:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13761:x1875730518615040:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 446us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836389.437709:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788836389.442231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.442885:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615168 00000100:00100000:2.0:1788836389.442895:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615168 00000100:00100000:2.0:1788836389.442986:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:2.0:1788836389.442995:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13784:x1875730518615168:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836389.443317:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13784:x1875730518615168:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 321us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.443325:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1788836389.446697:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.446870:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615296 00000100:00100000:2.0:1788836389.446881:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615296 00000100:00100000:2.0:1788836389.446938:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1788836389.447824:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13784:x1875730518615296:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836389.448086:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13784:x1875730518615296:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 270us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.448094:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:0.0:1788836389.451857:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836389.454222:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615424 00000100:00100000:3.0:1788836389.454237:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615424 00000100:00100000:2.0:1788836389.456626:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836389.456637:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875730518615424:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788836389.456665:0:14305:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d@192.168.203.52@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788836389.456715:0:14305:0:(genops.c:1385:class_connect()) connect: client 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d, cookie 0xcb5b7bc40b90a6d2 00000004:00100000:2.0:1788836389.456750:0:14305:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788836389.456757:0:14305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788836389.486551:0:14305:0:(import.c:65:import_set_state_nolock()) ffff9bd05274f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836389.486679:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2352:x1875730518615424:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 30041us (34829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.486689:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788836389.488434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836389.488513:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615552 00000100:00100000:3.0:1788836389.488522:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615552 00000100:00100000:3.0:1788836389.488596:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788836389.488606:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:0:x1875730518615552:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836389.488645:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788836389.488723:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:0:x1875730518615552:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836389.488731:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:2.0:1788836389.489316:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836389.491808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.492997:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615680 00000100:00100000:2.0:1788836389.493012:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615680 00000100:00100000:2.0:1788836389.493210:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836389.493223:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518615680:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836389.493271:0:14305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836389.493382:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518615680:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 162us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.493390:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836389.498414:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836389.498502:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615808 00000100:00100000:0.0:1788836389.498512:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615808 00000100:00100000:0.0:1788836389.498572:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836389.498583:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518615808:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788836389.498676:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518615808:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836389.498683:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836389.501426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836389.501463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836389.501492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836389.501587:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616192 00000100:00100000:3.0:1788836389.501596:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616192 00000100:00100000:3.0:1788836389.501650:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788836389.501675:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518616192:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788836389.502292:0:14306:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 554us 00000100:00100000:1.0:1788836389.503248:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518615936 00000100:00100000:1.0:1788836389.503259:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518615936 00000100:00100000:1.0:1788836389.503302:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616064 00000100:00100000:1.0:1788836389.503306:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616064 00000100:00100000:1.0:1788836389.503323:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788836389.503331:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875730518615936:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788836389.503379:0:14987:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d@192.168.203.52@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:1.0:1788836389.503413:0:14987:0:(genops.c:1385:class_connect()) connect: client 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d, cookie 0xcb5b7bc40b90a6d9 00002000:00100000:1.0:1788836389.503425:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d/ffff9bd07985b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836389.503449:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788836389.503760:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788836389.503792:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bd07985c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836389.503861:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2352:x1875730518615936:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 529us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836389.503869:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788836389.503889:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788836389.503895:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875730518616064:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788836389.503911:0:14987:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d@192.168.203.52@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:1.0:1788836389.503941:0:14987:0:(genops.c:1385:class_connect()) connect: client 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d, cookie 0xcb5b7bc40b90a6e0 00002000:00100000:1.0:1788836389.503947:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d/ffff9bd079858800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836389.503962:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788836389.505255:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788836389.505290:0:14987:0:(import.c:65:import_set_state_nolock()) ffff9bd07985e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836389.505368:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2352:x1875730518616064:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 1444us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836389.505379:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000004:00200000:2.0:1788836389.526192:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788836389.526313:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13761:x1875730518616192:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 24636us (24893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.526327:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:3.0:1788836389.585415:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836389.720529:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836389.720699:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616320 00000100:00100000:2.0:1788836389.720709:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616320 00000100:00100000:2.0:1788836389.720769:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788836389.720780:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:13805:x1875730518616320:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1788836389.720800:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836389.720825:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90a6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab1e expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.720887:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.720900:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.720914:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836389.720960:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836389.720964:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836389.720998:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.721040:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047998800/0xcb5b7bc40b90a6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab1e expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.721068:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab1e expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836389.721077:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836389.721080:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836389.721083:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999400, rc 0) 00000100:00100000:2.0:1788836389.722036:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:13805:x1875730518616320:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 1250us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836389.722047:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:3.0:1788836390.609014:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836391.248818:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530048:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.248886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836391.248960:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.248990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836391.249014:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836391.249019:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836391.249090:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530048 00000100:00100000:0.0:1788836391.249095:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538530304:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249097:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530048 00000100:00100000:0.0:1788836391.249125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836391.249141:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530176 00000100:00100000:0.0:1788836391.249142:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788836391.249144:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530176 00000100:00100000:0.0:1788836391.249147:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538529920:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249163:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836391.249171:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538530048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836391.249190:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538530432:0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836391.249218:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538530048:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836391.249239:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836391.249255:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836391.249260:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530560 00000100:00100000:2.0:1788836391.249262:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538530176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249263:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530560 00000100:00100000:0.0:1788836391.249290:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530304 00000100:00100000:2.0:1788836391.249291:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538530176:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836391.249293:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530304 00000100:00100000:2.0:1788836391.249296:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836391.249303:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530432 00000100:00100000:0.0:1788836391.249305:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530432 00000100:00100000:2.0:1788836391.249311:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538529920 00000100:00100000:2.0:1788836391.249314:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538529920 00000100:00100000:0.0:1788836391.249319:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836391.249325:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538530560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249333:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788836391.249338:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538529920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249373:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538530560:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836391.249380:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836391.249383:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538529920:12345-0@lo:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836391.249388:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788836391.249393:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788836391.249398:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538530304:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788836391.249414:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836391.249418:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836391.249420:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836391.249435:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538530304:12345-0@lo:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836391.249441:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836391.249442:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530176:0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249453:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530048:0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249453:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836391.249459:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538530432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836391.249462:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538530560:0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.249483:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538530432:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836391.249489:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836391.250270:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538529920:0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.250285:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538530432:0@lo:400:kworker.0 00000100:00100000:0.0:1788836391.250296:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538530304:0@lo:400:kworker.0 00000100:00100000:3.0:1788836391.254221:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836391.254244:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836391.254307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836391.254372:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530688 00000100:00100000:3.0:1788836391.254379:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530688 00000100:00100000:3.0:1788836391.254420:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836391.254428:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538530688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836391.254458:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836391.254496:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875730538530688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836391.254502:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836391.254548:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538530688:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788836391.343219:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00100000:0.0:1788836391.359930:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00080000:0.0:1788836391.360097:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788836391.633192:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836391.762765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836391.762789:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538530816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836391.762862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836391.762995:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530816 00000100:00100000:1.0:1788836391.763003:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530816 00000100:00100000:1.0:1788836391.763062:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836391.763072:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538530816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836391.763107:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836391.763175:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538530816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836391.763183:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836391.763316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538530816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836391.880330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836391.880468:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616448 00000100:00100000:2.0:1788836391.880476:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616448 00000100:00100000:2.0:1788836391.880552:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788836391.880562:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:13857:x1875730518616448:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:2.0:1788836391.880613:0:14303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836391.880702:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:13857:x1875730518616448:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 141us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836391.880709:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:0.0:1788836391.880845:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836391.884982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836391.885135:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616576 00000100:00100000:3.0:1788836391.885144:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616576 00000100:00100000:3.0:1788836391.885221:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788836391.885232:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:13857:x1875730518616576:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1788836391.885257:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788836391.885296:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836391.885385:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:13857:x1875730518616576:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 154us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836391.885393:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836391.890210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836391.890332:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616704 00000100:00100000:2.0:1788836391.890424:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616704 00000100:00100000:2.0:1788836391.890553:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836391.890564:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:13857:x1875730518616704:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788836391.890589:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836391.890704:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:13857:x1875730518616704:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 141us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836391.890711:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00080000:0.0:1788836391.890806:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836392.114403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.114545:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616832 00000100:00100000:2.0:1788836392.114555:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616832 00000100:00100000:2.0:1788836392.114628:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:2.0:1788836392.114639:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+10:13890:x1875730518616832:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836392.114656:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836392.114688:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998800/0xcb5b7bc40b90a6f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab25 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.114718:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998800/0xcb5b7bc40b90a6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab25 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.114730:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998800/0xcb5b7bc40b90a6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab25 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.114739:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998800, rc 0) 00000100:00100000:2.0:1788836392.114804:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518616832:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 167us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.114811:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1788836392.118889:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.119817:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518616960 00000100:00100000:2.0:1788836392.119841:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518616960 00000100:00100000:2.0:1788836392.119906:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1788836392.119918:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518616960:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836392.120228:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518616960:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 311us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.120237:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1788836392.132303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.132410:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617088 00000100:00100000:0.0:1788836392.132420:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617088 00000100:00100000:0.0:1788836392.132476:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:0.0:1788836392.132486:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518617088:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788836392.133106:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518617088:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 619us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.133116:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788836392.140697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.140878:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617216 00000100:00100000:0.0:1788836392.140888:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617216 00000100:00100000:0.0:1788836392.140946:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:0.0:1788836392.140955:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13897:x1875730518617216:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836392.143982:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13897:x1875730518617216:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 3017us (3284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.143997:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:1.0:1788836392.174568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.175712:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617344 00000100:00100000:2.0:1788836392.175735:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617344 00000100:00100000:2.0:1788836392.175806:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:2.0:1788836392.175817:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd065073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13897:x1875730518617344:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836392.176108:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd065073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13897:x1875730518617344:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 292us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.176116:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1788836392.181489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.181691:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617472 00000100:00100000:0.0:1788836392.181702:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617472 00000100:00100000:0.0:1788836392.181768:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788836392.181778:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13890:x1875730518617472:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788836392.181804:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836392.181822:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90a6fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab4f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836392.181862:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90a6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab4f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836392.181889:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd08217de00/0xcb5b7bc40b90a6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab4f expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836392.181899:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217de00, rc 0) 00000100:00100000:0.0:1788836392.181959:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13890:x1875730518617472:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 181us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.181966:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788836392.185366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.185461:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617600 00000100:00100000:0.0:1788836392.185477:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617600 00000100:00100000:0.0:1788836392.185639:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1788836392.185650:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13890:x1875730518617600:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788836392.185963:0:14297:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788836392.186177:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788836392.186182:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788836392.186185:0:14297:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788836392.186188:0:14297:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788836392.187697:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13890:x1875730518617600:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 2042us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.187711:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1788836392.190735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.191192:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617728 00000100:00100000:2.0:1788836392.191203:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617728 00000100:00100000:2.0:1788836392.191264:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:2.0:1788836392.191274:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13890:x1875730518617728:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836392.191292:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836392.191310:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab56 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.191383:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.191409:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.191418:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999600, rc 0) 00000100:00100000:2.0:1788836392.191562:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13890:x1875730518617728:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 289us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.191569:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1788836392.194758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.194957:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617856 00000100:00100000:0.0:1788836392.194967:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617856 00000100:00100000:0.0:1788836392.195026:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788836392.195044:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13890:x1875730518617856:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788836392.195397:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13890:x1875730518617856:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 362us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.195416:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1788836392.198059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.198146:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518617984 00000100:00100000:0.0:1788836392.198155:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518617984 00000100:00100000:0.0:1788836392.199076:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788836392.199091:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13890:x1875730518617984:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788836392.199321:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13890:x1875730518617984:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 233us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.199340:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:1.0:1788836392.203319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.204108:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618112 00000100:00100000:2.0:1788836392.204121:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618112 00000100:00100000:2.0:1788836392.204175:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788836392.204185:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd043bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13900:x1875730518618112:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836392.204489:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd043bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13900:x1875730518618112:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 304us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.204499:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788836392.207164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836392.207254:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618240 00000100:00100000:3.0:1788836392.207263:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618240 00000100:00100000:0.0:1788836392.207329:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1788836392.207431:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13900:x1875730518618240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788836392.210154:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13900:x1875730518618240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 2805us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836392.210168:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:1.0:1788836392.215868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836392.216378:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618368 00000100:00100000:3.0:1788836392.216390:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618368 00000100:00100000:3.0:1788836392.216441:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788836392.216450:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875730518618368:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788836392.216478:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 03b72b3e-8a8e-455d-8604-5896fa644ca9@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1788836392.216526:0:14304:0:(genops.c:1385:class_connect()) connect: client 03b72b3e-8a8e-455d-8604-5896fa644ca9, cookie 0xcb5b7bc40b90a70a 00000004:00100000:3.0:1788836392.216556:0:14304:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788836392.216684:0:14304:0:(import.c:65:import_set_state_nolock()) ffff9bcf479b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836392.216755:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2352:x1875730518618368:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 304us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836392.216763:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836392.223026:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836392.223127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836392.223708:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618624 00000100:00100000:3.0:1788836392.223719:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618624 00000100:00100000:3.0:1788836392.223920:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618496 00000100:00100000:3.0:1788836392.223925:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618496 00000100:00080000:0.0:1788836392.223970:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836392.224013:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836392.224027:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+7:13890:x1875730518618624:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836392.224069:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836392.224310:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+7:13890:x1875730518618624:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 285us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.224318:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836392.224364:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788836392.224373:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:0:x1875730518618496:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836392.224401:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788836392.224427:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:0:x1875730518618496:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 55us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.224433:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836392.227949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836392.228371:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618752 00000100:00100000:3.0:1788836392.228382:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618752 00000100:00100000:3.0:1788836392.228438:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836392.228448:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:13890:x1875730518618752:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788836392.228526:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:13890:x1875730518618752:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 79us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836392.228547:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836392.233777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.233984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836392.234066:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836392.234136:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619136 00000100:00100000:1.0:1788836392.234145:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619136 00000100:00100000:3.0:1788836392.234543:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1788836392.234555:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:13890:x1875730518619136:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788836392.234628:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788836392.234710:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:13890:x1875730518619136:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 157us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836392.234717:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836392.235417:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518618880 00000100:00100000:2.0:1788836392.235424:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518618880 00000100:00100000:2.0:1788836392.235450:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619008 00000100:00100000:2.0:1788836392.235453:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619008 00000100:00100000:2.0:1788836392.235465:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788836392.235471:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518618880:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788836392.235494:0:14985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 03b72b3e-8a8e-455d-8604-5896fa644ca9@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1788836392.235521:0:14985:0:(genops.c:1385:class_connect()) connect: client 03b72b3e-8a8e-455d-8604-5896fa644ca9, cookie 0xcb5b7bc40b90a711 00002000:00100000:2.0:1788836392.235530:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03b72b3e-8a8e-455d-8604-5896fa644ca9/ffff9bd079848000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836392.235540:0:14985:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788836392.235747:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788836392.235778:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9bd04ebfd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836392.235930:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2352:x1875730518618880:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 456us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.235938:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788836392.235953:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836392.235958:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875730518619008:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788836392.235975:0:14985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 03b72b3e-8a8e-455d-8604-5896fa644ca9@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1788836392.235991:0:14985:0:(genops.c:1385:class_connect()) connect: client 03b72b3e-8a8e-455d-8604-5896fa644ca9, cookie 0xcb5b7bc40b90a718 00002000:00100000:2.0:1788836392.235997:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03b72b3e-8a8e-455d-8604-5896fa644ca9/ffff9bd04ebfc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836392.236015:0:14985:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788836392.236145:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836392.236159:0:14985:0:(import.c:65:import_set_state_nolock()) ffff9bd047f4e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836392.236180:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2352:x1875730518619008:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 221us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.236186:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836392.479998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836392.480770:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619264 00000100:00100000:2.0:1788836392.480782:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619264 00000100:00100000:2.0:1788836392.481164:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788836392.481176:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:13921:x1875730518619264:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1788836392.481198:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836392.481219:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b90a71f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab80 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481290:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481303:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481316:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836392.481384:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836392.481388:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836392.481406:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481431:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999200/0xcb5b7bc40b90a71f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 8 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481464:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 7 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836392.481472:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836392.481475:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836392.481478:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047999e00, rc 0) 00000100:00100000:2.0:1788836392.481556:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+7:13921:x1875730518619264:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 383us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836392.481565:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:3.0:1788836392.656895:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836393.105040:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788836393.680593:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836394.705951:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788836394.919004:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d 00000001:00100000:2.0:1788836394.919036:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00000001:02000400:0.0:1788836395.450728:0:16268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788836395.729741:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836396.370537:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8cc5c45-b703-4cf0-83fd-6722cde04691:3305:1875730538530944:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.370604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538531456:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.370672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370697:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836396.370703:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538531328:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.370724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370750:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531072:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.370776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370793:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836396.370815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370834:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836396.370847:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531200:0@lo:400:kworker.0 00000100:00100000:1.0:1788836396.370849:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531072 00000100:00100000:1.0:1788836396.370856:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531072 00000100:00100000:3.0:1788836396.370867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.370893:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538530944 00000100:00100000:3.0:1788836396.370897:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538530944 00000100:00100000:1.0:1788836396.370902:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531200 00000100:00100000:1.0:1788836396.370904:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531200 00000100:00100000:1.0:1788836396.370919:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836396.370920:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788836396.370928:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3305:x1875730538530944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836396.370928:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.370971:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3305:x1875730538530944:12345-0@lo:400:kworker.0 Request processed in 44us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836396.370978:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788836396.371006:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531456 00000100:00100000:3.0:1788836396.371021:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531456 00000100:00100000:3.0:1788836396.371045:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531328 00000100:00100000:3.0:1788836396.371048:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531328 00000100:00100000:3.0:1788836396.371063:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836396.371068:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538531456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371099:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538531456:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836396.371105:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836396.371116:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836396.371121:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538531328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371148:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538531328:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836396.371154:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836396.371173:0:14985:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836396.371180:0:14985:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788836396.371283:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538531328:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371294:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e8cc5c45-b703-4cf0-83fd-6722cde04691:3305:1875730538530944:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371312:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538531456:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371391:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538531712:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836396.371446:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531712 00000100:00100000:3.0:1788836396.371450:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531712 00000100:00100000:3.0:1788836396.371472:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836396.371478:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538531712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836396.371483:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531072:12345-0@lo:400:kworker.0 Request processed in 557us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836396.371490:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836396.371503:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836396.371506:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538531712:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836396.371509:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371512:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836396.371536:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538531712:0@lo:400:kworker.0 00000100:00100000:1.0:1788836396.371547:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531200:12345-0@lo:400:kworker.0 Request processed in 39us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836396.371552:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836396.371641:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531584 00000100:00100000:3.0:1788836396.371645:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531584 00000100:00100000:3.0:1788836396.371668:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836396.371675:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836396.371700:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788836396.371731:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875730538531584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836396.371737:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836396.371775:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788836396.371787:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531200:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371798:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531072:0@lo:400:kworker.0 00000100:00100000:3.0:1788836396.371810:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1875730538531584:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788836396.372390:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836396.372397:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836396.372399:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788836396.450124:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00000001:00100000:1.0:1788836396.460664:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03b72b3e-8a8e-455d-8604-5896fa644ca9 00010000:00010000:0.0:1788836396.753360:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836396.881592:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538531840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836396.881665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836396.881873:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538531840 00000100:00100000:2.0:1788836396.881881:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538531840 00000100:00100000:2.0:1788836396.881934:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836396.881944:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538531840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836396.881979:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836396.882040:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538531840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836396.882047:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836396.883430:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538531840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836397.262726:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262803:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836397.262952:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619392 00000100:00100000:0.0:1788836397.262962:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619392 00000100:00100000:0.0:1788836397.263024:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:0.0:1788836397.263034:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2354:x1875730518619392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263105:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2354:x1875730518619392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263113:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:0.0:1788836397.263154:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619520 00000100:00100000:0.0:1788836397.263158:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619520 00000100:00100000:0.0:1788836397.263193:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619904 00000100:00100000:0.0:1788836397.263197:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619904 00000100:00100000:0.0:1788836397.263211:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836397.263217:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2354:x1875730518619520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263247:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2354:x1875730518619520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263253:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788836397.263262:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788836397.263268:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2354:x1875730518619904:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263288:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2354:x1875730518619904:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263294:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788836397.263309:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619776 00000100:00100000:0.0:1788836397.263318:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619776 00000100:00100000:0.0:1788836397.263338:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620032 00000100:00100000:0.0:1788836397.263367:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620032 00000100:00100000:0.0:1788836397.263389:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518619648 00000100:00100000:0.0:1788836397.263391:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518619648 00000100:00100000:0.0:1788836397.263401:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620160 00000100:00100000:0.0:1788836397.263403:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620160 00000100:00100000:0.0:1788836397.263415:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836397.263421:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518619776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263446:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518619776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263452:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836397.263461:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836397.263466:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2354:x1875730518620032:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263483:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2354:x1875730518620032:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 17us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263489:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788836397.263497:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836397.263502:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518619648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263517:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518619648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 15us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263523:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836397.263531:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788836397.263536:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2354:x1875730518620160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836397.263551:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2354:x1875730518620160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 15us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836397.263562:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:0.0:1788836397.263700:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836397.263704:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836397.263707:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788836397.777086:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836398.791721:0:16421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3ad29b60 20000000:00000080:2.0:1788836398.791741:0:16421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd05f898c00 uarg=0000000000000000 20000000:01000000:2.0:1788836398.791780:0:16421:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788836398.791786:0:16421:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788836398.791792:0:16421:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788836398.798744:0:16422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788836398.803581:0:16421:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788836398.818180:0:16421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788836398.818586:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836398.818760:0:16421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818778:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818786:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818793:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818802:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818809:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818815:0:16421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818852:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.818876:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 12 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.818890:0:16421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079795c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538531968:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836398.818987:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.819006:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.819014:0:16421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532096:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836398.819041:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.819049:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.819057:0:16421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532224:0@lo:104: 00000100:00100000:0.0:1788836398.819091:0:16421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836398.819119:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.819127:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 18 pid: 14297 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.819134:0:16421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532352:0@lo:104: 00000100:00100000:0.0:1788836398.819153:0:16421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788836398.819180:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.819188:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 18 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.819195:0:16421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532480:0@lo:104: 00000100:00100000:0.0:1788836398.819217:0:16421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836398.819229:0:16421:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836398.819600:0:15716:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788836398.819612:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532224 00000100:00100000:2.0:1788836398.819618:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532224 00000100:00100000:2.0:1788836398.819653:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532352 00000100:00100000:2.0:1788836398.819656:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532352 00000100:00100000:2.0:1788836398.819665:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532480 00000100:00100000:2.0:1788836398.819667:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532480 00000100:00100000:2.0:1788836398.819680:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836398.819687:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:16421:x1875730538532224:12345-0@lo:104: 00010000:00010000:2.0:1788836398.819698:0:15716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.819755:0:15716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788836398.819761:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd079794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+5:16421:x1875730538532224:12345-0@lo:104: Request processed in 75us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836398.819767:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836398.819784:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836398.819790:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+4:16421:x1875730538532352:12345-0@lo:104: 00010000:00010000:2.0:1788836398.819797:0:15716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.819827:0:15716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788836398.819832:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+4:16421:x1875730538532352:12345-0@lo:104: Request processed in 43us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836398.819837:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836398.819847:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836398.819853:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf4492a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:16421:x1875730538532480:12345-0@lo:104: 00010000:00010000:2.0:1788836398.819860:0:15716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.819897:0:15716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788836398.819902:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf4492a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e8cc5c45-b703-4cf0-83fd-6722cde04691+3:16421:x1875730538532480:12345-0@lo:104: Request processed in 50us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836398.819908:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788836398.819943:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836398.819949:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.819956:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0dc00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836398.819959:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.819968:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836398.819976:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836398.819982:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836398.820021:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820028:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836398.820054:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820062:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0dc00/0xcb5b7bc40b90a5a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a5ac expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820084:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836398.820087:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820092:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd042c0da00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836398.820094:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820100:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836398.820105:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836398.820109:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836398.820122:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820127:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836398.820140:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820147:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd042c0da00/0xcb5b7bc40b90a46a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a471 expref: -99 pid: 14984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820154:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836398.820157:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820173:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd047998600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1788836398.820176:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820183:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836398.820189:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836398.820193:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788836398.820205:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820210:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836398.820215:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820221:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9bd047998600/0xcb5b7bc40b90a41d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcb5b7bc40b90a424 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820235:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836398.820236:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836398.820238:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836398.820244:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836398.820249:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836398.820255:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836398.820267:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538532608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836398.820298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836398.820337:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532608 00000100:00100000:2.0:1788836398.820360:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532608 00010000:00010000:2.0:1788836398.820380:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 19 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836398.820398:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836398.820404:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538532608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836398.820413:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836398.820418:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 19 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820427:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 19 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.820442:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836398.820466:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538532608:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836398.820472:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788836398.820505:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538532608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836398.820957:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a5ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a5a5 expref: 18 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.820968:0:16421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532224:0@lo:104: 00000100:00100000:0.0:1788836398.820978:0:16421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532352:0@lo:104: 00000100:00100000:0.0:1788836398.820987:0:16421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532480:0@lo:104: 00000100:00100000:3.0:1788836398.821063:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538532736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836398.821095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836398.821159:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836398.821164:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538532864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836398.821184:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836398.821308:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532736 00000100:00100000:0.0:1788836398.821313:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532736 00010000:00010000:0.0:1788836398.821334:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 18 pid: 14297 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.821382:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532864 00000100:00100000:0.0:1788836398.821385:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532864 00010000:00010000:0.0:1788836398.821397:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 19 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.821411:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836398.821417:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3302:x1875730538532736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836398.821426:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836398.821430:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 19 pid: 14297 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821449:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 19 pid: 14297 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821461:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217d000/0xcb5b7bc40b90a471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a46a expref: 19 pid: 14297 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821471:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836398.821513:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:3302:x1875730538532736:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836398.821520:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836398.821535:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836398.821541:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:3302:x1875730538532864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836398.821549:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836398.821554:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 17 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821562:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 17 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821573:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd042c0d400/0xcb5b7bc40b90a424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcb5b7bc40b90a41d expref: 17 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.821581:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836398.821600:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:3302:x1875730538532864:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836398.821605:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836398.821793:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538532864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836398.821802:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e8cc5c45-b703-4cf0-83fd-6722cde04691:3302:1875730538532736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836398.827925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836398.828039:0:16421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079795c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538531968:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836398.828055:0:16421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079797800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875730538532096:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836398.828069:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620288 00000100:00100000:3.0:1788836398.828076:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620288 00010000:00010000:2.0:1788836398.828087:0:16421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836398.828106:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836398.828142:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788836398.828151:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2354:x1875730518620288:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836398.828166:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836398.828172:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836398.828184:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836398.828201:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd047999600/0xcb5b7bc40b90a703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab56 expref: 13 pid: 14298 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836398.828215:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836398.828279:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:2354:x1875730518620288:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 129us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836398.828286:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836398.832402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836398.834091:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620416 00000100:00100000:0.0:1788836398.834116:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620416 00010000:00010000:0.0:1788836398.834155:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836398.834196:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836398.834204:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:2353:x1875730518620416:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836398.834218:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836398.834224:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834235:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834251:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd040030600/0xcb5b7bc40b90a6cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316aaf4 expref: 12 pid: 14296 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834265:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834273:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834288:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834294:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834301:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834316:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834322:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836398.834326:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834334:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834378:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836398.834390:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836398.834461:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:2353:x1875730518620416:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 257us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836398.834469:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:2.0:1788836398.834532:0:16421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.834541:0:16421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836398.834552:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd08217d200/0xcb5b7bc40b90a72d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836399.824457:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836400.010677:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836400.010764:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620544 00000100:00100000:3.0:1788836400.010776:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620544 00000100:00100000:3.0:1788836400.010870:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:3.0:1788836400.010882:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+11:13775:x1875730518620544:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836400.010900:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836400.010921:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90a734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab87 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.010952:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90a734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab87 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.010965:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031600/0xcb5b7bc40b90a734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab87 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.010974:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031600, rc 0) 00000100:00100000:3.0:1788836400.011052:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620544:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 173us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.011058:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:1.0:1788836400.015322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836400.015421:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620672 00000100:00100000:3.0:1788836400.015432:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620672 00000100:00100000:3.0:1788836400.015477:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:3.0:1788836400.015486:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0543f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620672:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.015796:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0543f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620672:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 309us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.015815:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:3.0:1788836400.018243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836400.018397:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620800 00000100:00100000:1.0:1788836400.018407:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620800 00000100:00100000:1.0:1788836400.018463:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1788836400.018473:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620800:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.018703:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620800:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 231us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836400.018712:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1788836400.023640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836400.023730:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518620928 00000100:00100000:3.0:1788836400.023741:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518620928 00000100:00100000:3.0:1788836400.023802:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:3.0:1788836400.023812:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+12:13775:x1875730518620928:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836400.023829:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836400.023862:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90a73b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab8e expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.023889:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90a73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab8e expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.023901:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040031c00/0xcb5b7bc40b90a73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab8e expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.023910:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031c00, rc 0) 00000100:00100000:3.0:1788836400.023972:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13775:x1875730518620928:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 161us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.023979:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1788836400.026324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836400.026517:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621056 00000100:00100000:3.0:1788836400.026526:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621056 00000100:00100000:3.0:1788836400.026575:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:3.0:1788836400.026585:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13775:x1875730518621056:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.026883:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13775:x1875730518621056:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 299us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.026900:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1788836400.029478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836400.029561:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621184 00000100:00100000:0.0:1788836400.029570:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621184 00000100:00100000:0.0:1788836400.029623:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1788836400.029634:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13775:x1875730518621184:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836400.029872:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:13775:x1875730518621184:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 239us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.029880:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 10000000:01000000:1.0:1788836400.401434:0:14300:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836400.401442:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd07af70000 from 10 10000000:01000000:1.0:1788836400.401447:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836400.401491:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836400.401502:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836400.401513:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836400.401537:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538532992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.401600:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836400.401656:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.401727:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538532992 00000100:00100000:3.0:1788836400.401735:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538532992 00000100:00100000:3.0:1788836400.401787:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836400.401796:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+16:14300:x1875730538532992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836400.401813:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836400.401829:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90a749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a742 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.401864:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90a749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a742 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.401874:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd040030e00/0xcb5b7bc40b90a749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a742 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.401883:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030e00, rc 0) 00000100:00100000:3.0:1788836400.401931:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538532992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.401937:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788836400.402079:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538532992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836400.402092:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836400.402102:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836400.402151:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.402183:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836400.402211:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836400.402262:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533120 00000100:00100000:0.0:1788836400.402266:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533120 00000100:00100000:0.0:1788836400.402304:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788836400.402311:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538533120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836400.402979:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538533120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.402997:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836400.403130:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.403165:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.403203:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836400.403224:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836400.403261:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533248 00000100:00100000:0.0:1788836400.403266:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533248 00000100:00100000:0.0:1788836400.403295:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788836400.403302:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538533248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836400.403534:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538533248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836400.403541:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836400.403628:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788836400.408783:0:16506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788836400.409176:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788836400.409205:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836400.409217:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.409228:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd07978b600/0xcb5b7bc40b90a742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a749 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836400.409238:0:14300:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836400.409240:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd04ea62000 from 10 10000000:01000000:2.0:1788836400.409243:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836400.409284:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.409293:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.409304:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836400.409328:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836400.409518:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836400.409595:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.415118:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533376 00000100:00100000:3.0:1788836400.415132:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533376 00000100:00100000:2.0:1788836400.416033:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788836400.416054:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+17:14300:x1875730538533376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836400.416073:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836400.416092:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a750 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.416122:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a750 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.416133:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998400/0xcb5b7bc40b90a757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a750 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.416142:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998400, rc 0) 00000100:00100000:2.0:1788836400.416228:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (6709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836400.416236:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788836400.416329:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836400.416365:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836400.416374:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836400.416444:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.416480:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836400.416795:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60300 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.417058:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533504 00000100:00100000:3.0:1788836400.417066:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533504 00000100:00100000:3.0:1788836400.417096:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788836400.417104:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.418238:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1130us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.418258:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788836400.425050:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.425115:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836400.425191:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836400.425242:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047e60300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836400.425302:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533632 00000100:00100000:2.0:1788836400.425309:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533632 00000100:00100000:2.0:1788836400.425389:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788836400.425399:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836400.425594:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836400.425603:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836400.425737:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836400.426931:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788836400.427183:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788836400.427207:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836400.427218:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.427231:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999200/0xcb5b7bc40b90a750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a757 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836400.432075:0:14300:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836400.432079:0:14300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bcf45ede000 from 10 10000000:01000000:2.0:1788836400.432082:0:14300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836400.432121:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.432130:0:14300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.432141:0:14300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836400.432164:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836400.432227:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836400.433059:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.435034:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533760 00000100:00100000:3.0:1788836400.435049:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533760 00000100:00100000:2.0:1788836400.435162:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788836400.435173:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+18:14300:x1875730538533760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836400.435190:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836400.435206:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b90a765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcb5b7bc40b90a75e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.435233:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b90a765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a75e expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.435245:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd047998600/0xcb5b7bc40b90a765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcb5b7bc40b90a75e expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.435254:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd047998600, rc 0) 00000100:00100000:2.0:1788836400.435336:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538533760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836400.435368:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788836400.435479:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836400.435497:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.435506:0:14300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836400.435573:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.435606:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836400.435634:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd045cffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.435648:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538533888 00000100:00100000:3.0:1788836400.435652:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538533888 00000100:00100000:3.0:1788836400.435673:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788836400.435679:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538533888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.436522:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538533888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 838us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.436531:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788836400.436685:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538533888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836400.436729:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538534016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836400.436773:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836400.436806:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd049427180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836400.439136:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534016 00000100:00100000:3.0:1788836400.439152:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534016 00000100:00100000:3.0:1788836400.439202:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788836400.439213:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538534016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836400.439491:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:14300:x1875730538534016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836400.439508:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788836400.439575:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e8cc5c45-b703-4cf0-83fd-6722cde04691:14300:1875730538534016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836400.440294:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788836400.440394:0:14300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788836400.440414:0:14300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836400.440424:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836400.440434:0:14300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9bd047999600/0xcb5b7bc40b90a75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcb5b7bc40b90a765 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836400.848998:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836401.489176:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788836401.489253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836401.489826:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538534272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836401.489950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836401.489987:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836401.489994:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538534656:0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836401.490048:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534656 00000100:00100000:0.0:1788836401.490054:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534656 00000100:00100000:0.0:1788836401.490096:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836401.490105:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538534656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490152:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875730538534656:12345-0@lo:400:kworker.0 Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836401.490159:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836401.490282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875730538534656:0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490524:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534272 00000100:00100000:0.0:1788836401.490528:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534272 00000100:00100000:0.0:1788836401.490565:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836401.490571:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538534272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836401.490594:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788836401.490630:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875730538534272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836401.490635:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836401.490651:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538534528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836401.490697:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836401.490703:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538534400:0@lo:400:kworker.0 00000100:00100000:3.0:1788836401.490708:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534144 00000100:00100000:3.0:1788836401.490714:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534144 00000100:00100000:0.0:1788836401.490726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836401.490752:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788836401.490755:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836401.490761:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538534144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490771:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534528 00000100:00100000:0.0:1788836401.490776:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534528 00000100:00100000:0.0:1788836401.490808:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534400 00000100:00100000:0.0:1788836401.490811:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534400 00000100:00100000:3.0:1788836401.490817:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3304:x1875730538534144:12345-0@lo:400:kworker.0 Request processed in 56us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836401.490839:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836401.490846:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538534528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490880:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538534528:12345-0@lo:400:kworker.0 Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836401.490886:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836401.490898:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836401.490905:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538534400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490932:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538534400:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836401.490946:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788836401.490960:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836401.490989:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538534400:0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.490999:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538534528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836401.491027:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07acb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1875730538534272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836401.491033:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788836401.491087:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e8cc5c45-b703-4cf0-83fd-6722cde04691:3304:1875730538534144:0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.503179:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538534784:0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.503251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836401.503817:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538534912:0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.503863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836401.503898:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534784 00000100:00100000:2.0:1788836401.503906:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534784 00000100:00100000:2.0:1788836401.503954:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538534912 00000100:00100000:2.0:1788836401.503958:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538534912 00000100:00100000:2.0:1788836401.503988:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836401.503997:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538534784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.504241:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875730538534784:12345-0@lo:400:kworker.0 Request processed in 243us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.504249:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836401.504266:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836401.504273:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538534912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.504304:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875730538534912:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.504310:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788836401.504360:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836401.504389:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1875730538534912:0@lo:400:kworker.0 00000100:00100000:2.0:1788836401.504423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1875730538534784:0@lo:400:kworker.0 00000100:00100000:1.0:1788836401.752926:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.753198:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621312 00000100:00100000:2.0:1788836401.753207:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621312 00000100:00080000:0.0:1788836401.753337:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836401.754923:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836401.754943:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:14431:x1875730518621312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836401.754964:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.755019:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a76c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab95 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755088:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755103:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755115:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755130:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755137:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755143:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755490:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755910:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.755918:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836401.755946:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836401.755950:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836401.755995:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756006:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756012:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756019:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756025:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.756029:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756037:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756049:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.756051:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.756055:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756072:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756086:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756092:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756098:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756102:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.756106:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756112:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756119:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd04940b700) 00010000:00010000:2.0:1788836401.756122:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.756125:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756131:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a77a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756167:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a76c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab95 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756192:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2600/0xcb5b7bc40b90a781 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab95 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.756199:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836401.756201:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836401.756203:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2600, rc 0) 00000100:00100000:2.0:1788836401.756296:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:14431:x1875730518621312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1353us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.756305:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788836401.761943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.762811:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621568 00000100:00100000:2.0:1788836401.762822:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621568 00000100:00100000:2.0:1788836401.762883:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788836401.762893:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:14431:x1875730518621568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836401.762913:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.762931:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2e00/0xcb5b7bc40b90a788 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ab9c expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763013:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763027:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763039:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763099:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763121:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763128:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763961:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2000/0xcb5b7bc40b90a79d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763982:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2000/0xcb5b7bc40b90a79d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.763991:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2000/0xcb5b7bc40b90a79d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836401.764002:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788836401.764218:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764226:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764233:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764239:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.764244:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764252:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764275:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd04940be00) 00010000:00010000:2.0:1788836401.764278:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.764283:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764302:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a78f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764316:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764322:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764328:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764333:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.764336:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764479:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764489:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd04940bd00) 00010000:00010000:2.0:1788836401.764492:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.764668:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.764676:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a796 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.765165:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2e00/0xcb5b7bc40b90a788 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab9c expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.765180:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2000/0xcb5b7bc40b90a79d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab9c expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.765188:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04940b000) 00010000:00010000:2.0:1788836401.765190:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.765192:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2000, rc 0) 00000100:00100000:2.0:1788836401.766712:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14431:x1875730518621568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3810us (4769us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788836401.766724:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788836401.779022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836401.779878:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621696 00000100:00100000:3.0:1788836401.779889:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621696 00000100:00100000:3.0:1788836401.780003:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836401.780014:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14431:x1875730518621696:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788836401.780133:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14431:x1875730518621696:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 122us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836401.780141:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788836401.826564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.826938:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621824 00000100:00100000:2.0:1788836401.826948:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621824 00000100:00100000:2.0:1788836401.827016:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788836401.827027:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14437:x1875730518621824:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836401.827045:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.827064:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2e00/0xcb5b7bc40b90a7ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316aba3 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827126:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827140:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827151:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827178:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827187:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.827194:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828549:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828564:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828572:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828578:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3c00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.828582:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828590:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828606:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.828609:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.828613:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828620:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828643:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828649:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828655:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828659:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.828662:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828668:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828676:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd04940bd00) 00010000:00010000:2.0:1788836401.828678:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.828680:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828686:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828730:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2e00/0xcb5b7bc40b90a7ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aba3 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828742:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.828744:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.828755:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2e00/0xcb5b7bc40b90a7ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316aba3 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.828764:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2e00, rc 0) 00000100:00100000:2.0:1788836401.829329:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14437:x1875730518621824:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2300us (2769us total) trans 0 rc 301/301 00000100:00100000:2.0:1788836401.829338:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788836401.837141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836401.838160:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518621952 00000100:00100000:1.0:1788836401.838186:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518621952 00000100:00100000:1.0:1788836401.838300:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836401.838312:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14437:x1875730518621952:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:1.0:1788836401.838438:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14437:x1875730518621952:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 128us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836401.838446:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836401.841096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836401.841180:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622208 00000100:00100000:3.0:1788836401.841190:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622208 00000100:00100000:3.0:1788836401.841248:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836401.841258:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14437:x1875730518622208:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:3.0:1788836401.841313:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836401.841382:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999400/0xcb5b7bc40b90a6ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab1e expref: 9 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.841402:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:3.0:1788836401.841407:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836401.841623:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.841638:0:14305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 5 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.841646:0:14305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.841678:0:14305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 5 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.841691:0:14305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 5 pid: 14304 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836401.841720:0:14305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14305:1875730538535040:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836401.841832:0:14305:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836401.844436:0:14305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14305:1875730538535040:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836401.844464:0:14305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836401.844661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836401.844936:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622336 00000100:00100000:3.0:1788836401.844944:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622336 00010000:00010000:3.0:1788836401.845003:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 6 pid: 14304 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836401.845054:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836401.845063:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2354:x1875730518622336:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836401.845077:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836401.845085:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 6 pid: 14304 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845097:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 6 pid: 14304 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845118:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd047999e00/0xcb5b7bc40b90a726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ab80 expref: 6 pid: 14304 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845133:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:3.0:1788836401.845139:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845229:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845236:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.845258:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836401.845455:0:14305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.845462:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836401.845609:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2354:x1875730518622336:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 545us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836401.845617:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:2.0:1788836401.845894:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.845906:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.845915:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788836401.846409:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788836401.855932:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788836401.855954:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.855966:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.855985:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.856008:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.856013:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.856020:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.856036:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.856039:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.856043:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.856049:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a7c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836401.856072:0:14305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf8f8abd reply state 0000000063a6b351 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836401.856082:0:14305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836401.857926:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+10:14437:x1875730518622208:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 16658us (16827us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788836401.857939:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:3.0:1788836401.862300:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862320:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862327:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862334:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836401.862338:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862372:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd04940bd00) 00010000:00010000:3.0:1788836401.862390:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836401.862395:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836401.862419:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2400/0xcb5b7bc40b90a7c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.872532:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836401.955086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.955288:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622464 00000100:00100000:2.0:1788836401.955299:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622464 00000100:00100000:2.0:1788836401.955381:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788836401.955391:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:14445:x1875730518622464:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788836401.955413:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.955435:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abaa expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955520:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955533:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955544:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836401.955577:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836401.955586:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836401.955623:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955887:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abaa expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955907:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2a00/0xcb5b7bc40b90a7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abaa expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.955914:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.955917:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836401.955920:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2a00, rc 0) 00000100:00100000:2.0:1788836401.956029:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+10:14445:x1875730518622464:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 639us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.956037:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788836401.987430:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.987528:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622592 00000100:00100000:2.0:1788836401.987537:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622592 00000100:00100000:2.0:1788836401.987603:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788836401.987613:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:14446:x1875730518622592:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836401.987634:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.987653:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abb1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987713:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987726:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987737:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836401.987769:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836401.987773:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836401.987792:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987814:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3c00/0xcb5b7bc40b90a7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb1 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987832:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2c00/0xcb5b7bc40b90a7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb1 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.987841:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.987844:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836401.987847:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2c00, rc 0) 00000100:00100000:2.0:1788836401.987918:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:14446:x1875730518622592:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 305us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.987931:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788836401.992090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836401.992316:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622720 00000100:00100000:2.0:1788836401.992325:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622720 00000100:00100000:2.0:1788836401.992411:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788836401.992422:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:14446:x1875730518622720:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836401.992444:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836401.992465:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a7ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abb8 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992551:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992565:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992582:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992597:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992603:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992609:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992738:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992756:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992763:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836401.992795:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836401.992798:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836401.992815:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992828:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992835:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992842:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.992847:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.992851:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994278:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994299:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:2.0:1788836401.994302:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.994308:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994332:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994365:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994373:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994380:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994386:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836401.994389:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994395:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994404:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd04940b700) 00010000:00010000:2.0:1788836401.994406:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836401.994409:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994415:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a7f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994454:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a7ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb8 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994481:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb8 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836401.994488:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:2.0:1788836401.994491:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836401.994493:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2200, rc 0) 00000100:00100000:2.0:1788836401.994573:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+7:14446:x1875730518622720:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2152us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836401.994581:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788836402.002575:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538535168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836402.002642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836402.002793:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538535168 00000100:00100000:2.0:1788836402.002801:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538535168 00000100:00100000:2.0:1788836402.002902:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836402.002912:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538535168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836402.002949:0:14990:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788836402.003014:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538535168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.003021:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836402.003558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.003589:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518622976 00000100:00100000:3.0:1788836402.003594:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518622976 00000100:00100000:3.0:1788836402.003627:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1788836402.003634:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+7:14446:x1875730518622976:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836402.004386:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.004411:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abbf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836402.004575:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836402.004848:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a806 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abbf expref: 9 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.004862:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:3.0:1788836402.004866:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836402.004871:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abbf expref: 9 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.004885:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:3.0:1788836402.004950:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+8:14446:x1875730518622976:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1316us (1394us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788836402.004958:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788836402.006552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538535168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836402.013757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.013848:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518623232 00000100:00100000:2.0:1788836402.013868:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518623232 00000100:00100000:2.0:1788836402.013925:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788836402.013935:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+8:14446:x1875730518623232:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:2.0:1788836402.013998:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836402.014027:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a7ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abb8 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.014062:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:2.0:1788836402.014072:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836402.014096:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.014108:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.014118:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836402.014327:0:14303:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008271a033 reply state 0000000014984a79 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836402.014336:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836402.014534:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788836402.014660:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+9:14446:x1875730518623232:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 725us (910us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788836402.014666:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00010000:00010000:0.0:1788836402.016986:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017002:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017010:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017032:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836402.017038:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017046:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017065:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b700) 00010000:00010000:0.0:1788836402.017067:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788836402.017072:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.017078:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a814 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836402.019595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.019674:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518623488 00000100:00100000:1.0:1788836402.019683:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518623488 00000100:00100000:1.0:1788836402.019733:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836402.019743:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+8:14446:x1875730518623488:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836402.019989:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+9:14446:x1875730518623488:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 246us (402us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788836402.019997:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836402.022210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.025913:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518623744 00000100:00100000:0.0:1788836402.025927:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518623744 00000100:00100000:1.0:1788836402.029623:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788836402.029638:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+9:14446:x1875730518623744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788836402.029676:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836402.029698:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b90a81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abc6 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029783:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029798:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029811:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029839:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029848:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.029855:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836402.029987:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788836402.030077:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030085:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030092:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030098:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836402.030101:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030108:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030120:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:1.0:1788836402.030123:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836402.030128:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030143:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030158:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030163:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030169:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030174:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836402.030176:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030182:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030189:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd07a955e00) 00010000:00010000:1.0:1788836402.030191:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836402.030194:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030200:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030238:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b90a81b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abc6 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030259:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:1.0:1788836402.030274:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836402.030280:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b90a81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abc6 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.030291:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ae00, rc 0) 00000100:00100000:1.0:1788836402.030415:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+10:14446:x1875730518623744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 780us (8214us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788836402.030423:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788836402.038674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.038988:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518623872 00000100:00100000:2.0:1788836402.039000:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518623872 00000100:00100000:2.0:1788836402.039058:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788836402.039069:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+10:14446:x1875730518623872:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836402.039092:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836402.039115:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a837 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abcd expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039203:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039229:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039239:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836402.039265:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788836402.039268:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836402.039285:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039313:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3200/0xcb5b7bc40b90a837 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039332:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.039372:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:2.0:1788836402.039387:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836402.039391:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb3e00, rc 0) 00000100:00100000:2.0:1788836402.039458:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+11:14446:x1875730518623872:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 391us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.039465:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788836402.044079:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.044158:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624000 00000100:00100000:1.0:1788836402.044167:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624000 00000100:00100000:1.0:1788836402.044221:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788836402.044231:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+11:14446:x1875730518624000:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:1.0:1788836402.053180:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+11:14446:x1875730518624000:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 8940us (9099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836402.053195:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788836402.061956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.062068:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624256 00000100:00100000:1.0:1788836402.062079:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624256 00000100:00100000:1.0:1788836402.062137:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788836402.062148:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07d158050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+11:14446:x1875730518624256:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836402.062437:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07d158050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b72b3e-8a8e-455d-8604-5896fa644ca9+12:14446:x1875730518624256:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 291us (489us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788836402.062445:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836402.115391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.115485:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624384 00000100:00100000:1.0:1788836402.115507:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624384 00000100:00100000:1.0:1788836402.115570:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788836402.115580:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+10:14452:x1875730518624384:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788836402.115600:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836402.115620:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b90a845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abd4 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115679:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115693:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115704:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115716:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115723:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115729:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115810:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115819:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115826:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836402.115859:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788836402.115862:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788836402.115912:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115923:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115929:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115935:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115941:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836402.115946:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115953:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115965:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:1.0:1788836402.115968:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836402.115982:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.115989:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116004:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116020:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116024:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116029:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836402.116032:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116038:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116045:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd07a955e00) 00010000:00010000:1.0:1788836402.116047:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836402.116050:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116055:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a853 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116087:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ae00/0xcb5b7bc40b90a845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abd4 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116101:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a400/0xcb5b7bc40b90a85a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abd4 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.116107:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:1.0:1788836402.116109:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788836402.116117:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978a400, rc 0) 00000100:00100000:1.0:1788836402.116187:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+11:14452:x1875730518624384:12345-192.168.203.52@tcp:101:bash.0 Request processed in 609us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836402.116194:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836402.119542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.119743:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624640 00000100:00100000:0.0:1788836402.119753:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624640 00000100:00100000:0.0:1788836402.119810:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788836402.119820:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+11:14452:x1875730518624640:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788836402.119841:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836402.119867:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a861 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abdb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.119995:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.120025:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.120035:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.120071:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.120084:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 11 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836402.120099:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd0454ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538535296:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788836402.120193:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aeb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836402.122644:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd0454ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538535296:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836402.122673:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.123994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.124066:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624768 00000100:00100000:1.0:1788836402.124076:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624768 00010000:00010000:1.0:1788836402.124114:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 12 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836402.124170:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788836402.124180:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+12:2354:x1875730518624768:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836402.124202:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836402.124209:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 12 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124224:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 12 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124247:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a83e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abcd expref: 12 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124264:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:1.0:1788836402.124270:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124291:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124300:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.124338:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836402.124378:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.124388:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.124413:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.124423:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.124431:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836402.124439:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03b72b3e-8a8e-455d-8604-5896fa644ca9+11:2354:x1875730518624768:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 258us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836402.124448:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:3.0:1788836402.125796:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125810:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125819:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836402.125842:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836402.125866:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125873:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125879:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125885:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217ce00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836402.125889:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125896:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125906:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:3.0:1788836402.125908:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836402.125912:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.125918:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ce00/0xcb5b7bc40b90a868 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788836402.125931:0:14304:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e58fd855 reply state 000000001893d94e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.125939:0:14304:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788836402.125979:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c400/0xcb5b7bc40b90a861 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.126005:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.126013:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.126015:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788836402.126017:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:3.0:1788836402.126066:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14452:x1875730518624640:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6247us (6534us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788836402.126073:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:3.0:1788836402.134579:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134598:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134605:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134611:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836402.134616:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134623:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134640:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd04506a200) 00010000:00010000:3.0:1788836402.134643:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836402.134647:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.134669:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a86f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.140224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.140699:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518624896 00000100:00100000:2.0:1788836402.140709:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518624896 00000100:00100000:2.0:1788836402.140791:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788836402.140803:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+13:14452:x1875730518624896:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788836402.140847:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836402.140870:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a884 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abe2 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.140956:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.140978:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.140990:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836402.141029:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788836402.141043:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836402.141064:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.141074:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.141096:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a884 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.141112:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.141121:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:2.0:1788836402.141139:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836402.141142:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb3a00, rc 0) 00000100:00100000:2.0:1788836402.141209:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14452:x1875730518624896:12345-192.168.203.52@tcp:101:bash.0 Request processed in 409us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.141217:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788836402.146465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.146602:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518625152 00000100:00100000:1.0:1788836402.146611:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518625152 00000100:00100000:1.0:1788836402.146664:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836402.146674:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14452:x1875730518625152:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788836402.147034:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+15:14452:x1875730518625152:12345-192.168.203.52@tcp:35:bash.0 Request processed in 360us (587us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788836402.147042:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788836402.241541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.241690:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518625408 00000100:00100000:3.0:1788836402.241700:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518625408 00000100:00100000:3.0:1788836402.241771:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788836402.241783:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+15:14462:x1875730518625408:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788836402.241808:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.241829:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abe9 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836402.241913:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788836402.242040:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a892 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe9 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.242055:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd04940b400) 00010000:00010000:3.0:1788836402.242059:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836402.242064:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe9 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.242078:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:3.0:1788836402.242137:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:14462:x1875730518625408:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 356us (606us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788836402.242145:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788836402.245188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.245674:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518625664 00000100:00100000:1.0:1788836402.245684:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518625664 00000100:00100000:1.0:1788836402.245753:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788836402.245764:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:14462:x1875730518625664:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788836402.246007:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+17:14462:x1875730518625664:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 244us (827us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788836402.246014:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788836402.289117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.289216:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518625920 00000100:00100000:2.0:1788836402.289227:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518625920 00000100:00100000:2.0:1788836402.289293:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788836402.289304:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+17:14465:x1875730518625920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788836402.289329:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836402.289380:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a8a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abf0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.289483:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a8a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.289497:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.289508:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836402.289518:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836402.289646:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a8a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf0 expref: 20 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.289665:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf0 expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.289693:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:2.0:1788836402.289696:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836402.289700:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb2800, rc 0) 00000100:00100000:2.0:1788836402.289774:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:14465:x1875730518625920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 470us (665us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788836402.289781:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788836402.296995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.297043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.297118:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626176 00000100:00100000:3.0:1788836402.297142:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626176 00000100:00100000:3.0:1788836402.297212:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788836402.297222:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:2354:x1875730518626176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836402.297235:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836402.297258:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a8a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf0 expref: 19 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.297287:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.297292:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836402.297373:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:2354:x1875730518626176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 123us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836402.297381:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788836402.297458:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626048 00000100:00100000:1.0:1788836402.297463:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626048 00000100:00100000:1.0:1788836402.297501:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788836402.297509:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:14465:x1875730518626048:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788836402.297574:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297598:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297608:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297633:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297639:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297646:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297652:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978a800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:1.0:1788836402.297656:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297663:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297671:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:1.0:1788836402.297674:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788836402.297678:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.297684:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978a800/0xcb5b7bc40b90a8b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836402.297720:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:14465:x1875730518626048:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 212us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836402.297735:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788836402.302238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.302330:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626432 00000100:00100000:2.0:1788836402.302370:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626432 00000100:00100000:2.0:1788836402.302422:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788836402.302433:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:14465:x1875730518626432:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788836402.302689:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:14465:x1875730518626432:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 257us (460us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788836402.302697:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000040:00080000:3.0:1788836402.321239:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788836402.374668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.374711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.374753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.374782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.374811:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626816 00000100:00100000:0.0:1788836402.374821:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626816 00000100:00100000:0.0:1788836402.374882:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518627072 00000100:00100000:0.0:1788836402.374885:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518627072 00000100:00100000:0.0:1788836402.374912:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626688 00000100:00100000:0.0:1788836402.374915:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626688 00000100:00100000:0.0:1788836402.374949:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836402.374960:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2353:x1875730518626816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836402.375045:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2353:x1875730518626816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.375054:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836402.375074:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836402.375082:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2353:x1875730518627072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836402.375107:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2353:x1875730518627072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.375113:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836402.375124:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788836402.375131:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2353:x1875730518626688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788836402.375153:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2353:x1875730518626688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.375158:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:0.0:1788836402.375179:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836402.375185:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836402.375210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.375232:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626944 00000100:00100000:0.0:1788836402.375235:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626944 00000100:00100000:0.0:1788836402.375274:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836402.375276:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518626560 00000100:00100000:0.0:1788836402.375282:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2353:x1875730518626944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836402.375292:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518626560 00000100:00100000:0.0:1788836402.375309:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2353:x1875730518626944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.375323:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788836402.375331:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00080000:0.0:1788836402.375369:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836402.375371:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf449db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2353:x1875730518626560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788836402.375407:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf449db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2353:x1875730518626560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.375415:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788836402.569755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.570838:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518627328 00000100:00100000:3.0:1788836402.570850:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518627328 00000100:00100000:3.0:1788836402.571156:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788836402.571167:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:14497:x1875730518627328:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788836402.571192:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.571213:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a8bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abf7 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.571319:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90a8c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.571334:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90a8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.571368:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90a8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836402.571392:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836402.571933:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a8bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf7 expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.571957:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90a8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf7 expref: 21 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.571965:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.571977:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836402.571980:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031a00, rc 0) 00000100:00100000:3.0:1788836402.572054:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:14497:x1875730518627328:12345-192.168.203.52@tcp:101:cat.0 Request processed in 888us (3202us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788836402.572061:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:1.0:1788836402.577042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.577133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836402.577228:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518627584 00000100:00100000:2.0:1788836402.577238:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518627584 00000100:00100000:2.0:1788836402.577298:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788836402.577308:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:14497:x1875730518627584:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1788836402.577708:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+22:14497:x1875730518627584:12345-192.168.203.52@tcp:35:cat.0 Request processed in 399us (672us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788836402.577716:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788836402.578088:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518627712 00000100:00100000:0.0:1788836402.578094:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518627712 00000100:00100000:0.0:1788836402.578134:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788836402.578194:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+22:2355:x1875730518627712:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836402.578208:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836402.578233:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031a00/0xcb5b7bc40b90a8c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abf7 expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.578250:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:0.0:1788836402.578265:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836402.578304:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:2355:x1875730518627712:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 163us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.587137:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788836402.636507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.636613:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518627968 00000100:00100000:3.0:1788836402.636624:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518627968 00000100:00100000:3.0:1788836402.636717:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788836402.636727:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:14503:x1875730518627968:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788836402.636759:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.636779:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a8d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316abfe expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.636898:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.636913:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.636940:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.636948:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.636992:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.637008:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 22 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.637022:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14303:1875730538535424:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836402.637179:0:14303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.637188:0:14303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.637197:0:14303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14303:1875730538535552:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836402.637222:0:14303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836402.641085:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14303:1875730538535424:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836402.641102:0:14303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14303:1875730538535552:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788836402.641134:0:14303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836402.641530:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.641723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.642589:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628096 00000100:00100000:0.0:1788836402.642600:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628096 00010000:00010000:0.0:1788836402.642642:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 23 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836402.643021:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628224 00000100:00100000:0.0:1788836402.643026:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628224 00010000:00010000:0.0:1788836402.643043:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 24 pid: 14304 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.643103:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788836402.643115:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:2354:x1875730518628096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836402.643130:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836402.643137:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 24 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643151:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 24 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643172:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3a00/0xcb5b7bc40b90a88b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abe2 expref: 24 pid: 14303 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643188:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.643193:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643201:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643207:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836402.643282:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+23:2354:x1875730518628096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 169us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.643285:0:14288:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788836402.643289:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836402.643294:0:14288:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788836402.643363:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1788836402.643372:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+22:2354:x1875730518628224:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836402.643380:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836402.643396:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643406:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643419:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a876 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316abdb expref: 22 pid: 14304 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643428:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.643432:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643439:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643446:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643465:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836402.643486:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:2354:x1875730518628224:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 116us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836402.643492:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00010000:00010000:3.0:1788836402.643512:0:14303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643520:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836402.643538:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836402.643707:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a8d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abfe expref: 22 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643727:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030400/0xcb5b7bc40b90a8d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316abfe expref: 21 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.643734:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.643737:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788836402.643739:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030400, rc 0) 00000100:00100000:3.0:1788836402.643764:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:14503:x1875730518627968:12345-192.168.203.52@tcp:101:dd.0 Request processed in 7040us (7267us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788836402.643771:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788836402.647488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.647586:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628480 00000100:00100000:3.0:1788836402.647596:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628480 00000100:00100000:3.0:1788836402.647651:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788836402.647661:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+21:14503:x1875730518628480:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:3.0:1788836402.647930:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.647948:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.647959:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836402.648016:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788836402.648043:0:14304:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e215844 reply state 0000000044a30a7c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836402.648053:0:14304:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836402.648166:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14503:x1875730518628480:12345-192.168.203.52@tcp:36:dd.0 Request processed in 505us (685us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788836402.648173:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000020:00080000:3.0:1788836402.648178:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788836402.653150:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.653386:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628608 00000100:00100000:3.0:1788836402.653397:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628608 00000100:00100000:3.0:1788836402.653458:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788836402.653468:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14503:x1875730518628608:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788836402.653490:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.653511:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b90a8ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac05 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.653894:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b90a8ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac05 expref: 25 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.653910:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b90a8ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac05 expref: 25 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836402.653949:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:2.0:1788836402.653953:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836402.653957:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031400, rc 0) 00000100:00100000:2.0:1788836402.654043:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14503:x1875730518628608:12345-192.168.203.52@tcp:101:dd.0 Request processed in 575us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836402.654052:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00010000:00010000:0.0:1788836402.659472:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659507:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659515:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659521:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836402.659525:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659533:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659550:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:0.0:1788836402.659553:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836402.659558:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.659563:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030600/0xcb5b7bc40b90a8e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836402.669263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836402.669381:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628864 00000100:00100000:0.0:1788836402.669391:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628864 00000100:00100000:0.0:1788836402.669450:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788836402.669459:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14503:x1875730518628864:12345-192.168.203.52@tcp:103:dd.0 00010000:00010000:0.0:1788836402.669475:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836402.669499:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031400/0xcb5b7bc40b90a8ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac05 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836402.669534:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:0.0:1788836402.669538:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836402.669589:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+23:14503:x1875730518628864:12345-192.168.203.52@tcp:103:dd.0 Request processed in 131us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836402.669596:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788836402.673187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836402.673285:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518628992 00000100:00100000:1.0:1788836402.673295:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518628992 00000100:00100000:1.0:1788836402.673469:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1788836402.673479:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+23:14503:x1875730518628992:12345-192.168.203.52@tcp:58:dd.0 00010000:00010000:1.0:1788836402.673571:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.673587:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836402.673598:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836402.674770:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836402.675277:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788836402.675540:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788836402.675669:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+23:14503:x1875730518628992:12345-192.168.203.52@tcp:58:dd.0 Request processed in 2188us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836402.675679:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788836402.679159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836402.679268:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629120 00000100:00100000:3.0:1788836402.679279:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629120 00000100:00100000:3.0:1788836402.679338:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788836402.679380:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+23:14503:x1875730518629120:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788836402.679403:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836402.679423:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac0c expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679482:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679493:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679511:0:14304:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679536:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679550:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836402.679553:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836402.679557:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836402.679565:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040031800, rc 0) 00000100:00100000:3.0:1788836402.679621:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14503:x1875730518629120:12345-192.168.203.52@tcp:101:dd.0 Request processed in 245us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836402.679628:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:2.0:1788836402.897015:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836403.346243:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836403.346253:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836403.346310:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836403.346319:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788836403.346513:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14336:1875730538535680:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788836403.346621:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836403.356004:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.356146:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629248 00000100:00100000:0.0:1788836403.356156:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629248 00000100:00100000:0.0:1788836403.356230:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836403.356241:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518629248:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788836403.356330:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518629248:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836403.356372:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00080000:1.0:1788836403.356516:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836403.363702:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07ac73480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14336:1875730538535680:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788836403.367021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.367751:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629376 00000100:00100000:3.0:1788836403.367761:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629376 00000100:00100000:3.0:1788836403.367827:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788836403.367837:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14504:x1875730518629376:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836403.367879:0:14304:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836403.367998:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14504:x1875730518629376:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 162us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.368018:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788836403.374306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.374536:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629504 00000100:00100000:2.0:1788836403.374546:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629504 00000100:00100000:2.0:1788836403.374607:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788836403.374616:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14504:x1875730518629504:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788836403.374684:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374714:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374732:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374793:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374802:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374809:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374833:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374841:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374848:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836403.374885:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788836403.374889:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836403.374901:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374912:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374929:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374936:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374941:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.374945:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374953:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374976:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04940b000) 00010000:00010000:2.0:1788836403.374979:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836403.374984:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.374990:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3800/0xcb5b7bc40b90a902 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375004:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375009:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375014:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375019:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.375028:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375034:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375042:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bd04940b700) 00010000:00010000:2.0:1788836403.375045:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836403.375119:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375128:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a909 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375144:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375149:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375156:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375160:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.375163:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375169:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375177:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:2.0:1788836403.375311:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836403.375321:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.375327:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a910 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.375561:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14504:x1875730518629504:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 942us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.375569:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788836403.384758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.384892:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629760 00000100:00100000:3.0:1788836403.384902:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629760 00000100:00100000:3.0:1788836403.384969:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1788836403.384981:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+24:14504:x1875730518629760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836403.385001:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836403.385020:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac13 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385239:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385452:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385467:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836403.385480:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836403.385579:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385587:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385593:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385599:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd040030800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836403.385603:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385623:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385637:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:3.0:1788836403.385639:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836403.385644:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385651:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a91e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385696:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a917 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac13 expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385707:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd04940b000) 00010000:00010000:3.0:1788836403.385710:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836403.385714:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac13 expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.385796:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:3.0:1788836403.385860:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07acb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518629760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 881us (1110us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788836403.385868:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788836403.397701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.397869:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518629888 00000100:00100000:2.0:1788836403.397878:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518629888 00000100:00100000:2.0:1788836403.397981:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788836403.397991:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518629888:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788836403.398028:0:14303:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788836403.398164:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518629888:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 172us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.398172:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788836403.401980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836403.403298:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518630144 00000100:00100000:1.0:1788836403.403311:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518630144 00000100:00100000:1.0:1788836403.403524:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788836403.403535:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+25:14504:x1875730518630144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836403.403554:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836403.403575:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a92c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac1a expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836403.404591:0:14304:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1788836403.404599:0:14304:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788836403.404658:0:14304:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788836403.405310:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a933 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836403.405327:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836403.405499:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836403.405571:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ac00/0xcb5b7bc40b90a92c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac1a expref: 28 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836403.405591:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac1a expref: 27 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836403.405601:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd07a955e00) 00010000:00010000:1.0:1788836403.405613:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836403.405617:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07978ba00, rc 0) 00000100:00100000:1.0:1788836403.405688:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+27:14504:x1875730518630144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2155us (3724us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788836403.405696:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788836403.419380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.420099:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518630400 00000100:00100000:3.0:1788836403.420112:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518630400 00000100:00100000:3.0:1788836403.420174:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788836403.420194:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+27:14504:x1875730518630400:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836403.420280:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836403.420308:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978ba00/0xcb5b7bc40b90a933 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac1a expref: 27 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.420330:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd07a955e00) 00010000:00010000:3.0:1788836403.420754:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836403.420898:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.420914:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.420925:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.420940:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.420948:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.420973:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421035:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421043:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421050:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421055:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.421059:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421066:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421074:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd04940b500) 00010000:00010000:2.0:1788836403.421077:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836403.421081:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421087:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a941 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421096:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421102:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421116:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421121:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2800 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.421124:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421129:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421137:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcea4645c (ffff9bd04940b700) 00010000:00010000:2.0:1788836403.421139:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836403.421142:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.421147:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a948 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcea4645c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.421258:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+26:14504:x1875730518630400:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1058us (1878us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788836403.421266:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788836403.425624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.426143:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518630528 00000100:00100000:3.0:1788836403.426155:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518630528 00000100:00100000:3.0:1788836403.426223:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788836403.426234:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+26:14504:x1875730518630528:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836403.426261:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836403.426284:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a94f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac21 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426319:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a956 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426332:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426599:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a956 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426703:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030000/0xcb5b7bc40b90a94f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac21 expref: 28 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426721:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040030800/0xcb5b7bc40b90a956 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac21 expref: 27 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.426741:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:3.0:1788836403.426743:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788836403.426746:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030800, rc 0) 00000100:00100000:3.0:1788836403.426817:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+27:14504:x1875730518630528:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 585us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.426825:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788836403.430522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.430772:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518630784 00000100:00100000:2.0:1788836403.430781:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518630784 00000100:00100000:2.0:1788836403.430833:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788836403.430843:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+27:14504:x1875730518630784:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788836403.430925:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.430958:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.430980:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836403.431875:0:14304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788836403.431894:0:14304:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 456566550441ns, next at 457566546837ns, rc = 0 00000004:00010000:2.0:1788836403.432004:0:14304:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000836f6af0 reply state 00000000f5248753 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.432015:0:14304:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836403.432133:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+29:14504:x1875730518630784:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1288us (1617us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788836403.432140:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:3.0:1788836403.434668:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434686:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434694:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434700:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3e00 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:3.0:1788836403.434705:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434712:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434740:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:3.0:1788836403.434743:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836403.434747:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.434754:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3e00/0xcb5b7bc40b90a95d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836403.435199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.435278:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518630912 00000100:00100000:0.0:1788836403.435288:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518630912 00000100:00100000:0.0:1788836403.435373:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788836403.435383:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+28:14504:x1875730518630912:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836403.435412:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836403.435431:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac28 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.435490:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 29 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.435517:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 29 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.435538:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:0.0:1788836403.435541:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788836403.435543:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd08217ca00, rc 0) 00000100:00100000:0.0:1788836403.435659:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+29:14504:x1875730518630912:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 278us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836403.435667:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788836403.445002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.445101:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518631040 00000100:00100000:0.0:1788836403.445111:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518631040 00000100:00100000:0.0:1788836403.445178:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788836403.445199:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2354:x1875730518631040:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788836403.445621:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2354:x1875730518631040:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 423us (629us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788836403.445629:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788836403.448823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.449022:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518631296 00000100:00100000:2.0:1788836403.449033:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518631296 00000100:00100000:2.0:1788836403.449093:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788836403.449103:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+29:14504:x1875730518631296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788836403.449939:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+30:14504:x1875730518631296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 831us (1120us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788836403.449949:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788836403.452640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.452747:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518631552 00000100:00100000:2.0:1788836403.452756:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518631552 00000100:00100000:2.0:1788836403.452813:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788836403.452823:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+30:14504:x1875730518631552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836403.452950:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ac70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+30:14504:x1875730518631552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.452958:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788836403.457996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.458217:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518631680 00000100:00100000:2.0:1788836403.458227:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518631680 00000100:00100000:2.0:1788836403.458325:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788836403.458384:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+30:14504:x1875730518631680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836403.458407:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836403.458426:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a96b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac2f expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458519:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458536:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458546:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836403.458585:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788836403.458605:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458632:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2800/0xcb5b7bc40b90a96b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac2f expref: 32 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458650:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac2f expref: 31 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.458672:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:2.0:1788836403.458675:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788836403.458678:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd07efb3000, rc 0) 00000100:00100000:2.0:1788836403.458744:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+31:14504:x1875730518631680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 410us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.458751:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788836403.462122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.462366:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518631808 00000100:00100000:3.0:1788836403.462376:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518631808 00000100:00100000:3.0:1788836403.462436:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836403.462448:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+6:2353:x1875730518631808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836403.462470:0:14987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836403.462490:0:14987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac36 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836403.462519:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7a32, blocks: 0x1 00010000:00010000:3.0:1788836403.462538:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=456s v=(0 0) 00010000:00010000:3.0:1788836403.462542:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836403.462551:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.462571:0:14987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.462585:0:14987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030000, rc 0) 00000100:00100000:3.0:1788836403.462647:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2353:x1875730518631808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 201us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.462654:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788836403.473208:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.473381:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632064 00000100:00100000:2.0:1788836403.473391:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632064 00000100:00100000:2.0:1788836403.473439:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1788836403.473449:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+31:14504:x1875730518632064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788836403.473558:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+31:14504:x1875730518632064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.473567:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788836403.477710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.477763:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632192 00000100:00100000:2.0:1788836403.477776:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632192 00000100:00100000:2.0:1788836403.477832:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788836403.477842:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+31:14504:x1875730518632192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788836403.531025:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1788836403.531063:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788836403.531073:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788836403.531079:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788836403.531300:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14504:x1875730518632192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 53453us (53591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836403.531311:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788836403.532024:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538535808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788836403.532079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836403.532200:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538535808 00000100:00100000:2.0:1788836403.532208:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538535808 00000100:00100000:2.0:1788836403.532268:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836403.532277:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538535808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788836403.532452:0:16287:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788836403.532457:0:16287:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788836403.532459:0:16287:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788836403.532471:0:16287:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788836402 -> 1788836402 00002000:00010000:2.0:1788836403.532473:0:16287:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788836403.532511:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd0454b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875730538535808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (431us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788836403.532519:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788836403.532561:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd07a77ad80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788836403.532567:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538535808:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788836403.532689:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836403.535707:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.535853:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632320 00000100:00100000:0.0:1788836403.535862:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632320 00000100:00100000:0.0:1788836403.535975:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788836403.535986:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2354:x1875730518632320:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788836403.536100:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2354:x1875730518632320:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 116us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836403.536122:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788836403.538946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.539035:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632576 00000100:00100000:0.0:1788836403.539046:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632576 00000100:00100000:0.0:1788836403.539117:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788836403.539128:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14504:x1875730518632576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788836403.539299:0:14305:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836403.539327:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3000/0xcb5b7bc40b90a972 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac2f expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.539381:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:0.0:1788836403.539386:0:14305:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836403.539417:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.539431:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.539442:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836403.539633:0:14305:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0fc4c73 reply state 00000000977dbdce transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.539643:0:14305:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788836403.539743:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+15:14504:x1875730518632576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 616us (804us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788836403.539750:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788836403.544481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.544550:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632704 00000100:00100000:3.0:1788836403.544560:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632704 00000100:00100000:3.0:1788836403.544621:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788836403.544632:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:14504:x1875730518632704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836403.544651:0:16287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836403.544670:0:16287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb59b48549316ac3d expref: -99 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.544714:0:16287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.544722:0:16287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836403.544726:0:16287:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836403.544732:0:16287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.544764:0:16287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.544798:0:16287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836403.544812:0:16287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16287:1875730538535936:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788836403.544895:0:16287:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd047a8b9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788836403.545579:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545598:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545605:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545611:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217d000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836403.545616:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545623:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545638:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:0.0:1788836403.545641:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836403.545645:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.545651:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217d000/0xcb5b7bc40b90a980 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.549576:0:16287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07af25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16287:1875730538535936:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836403.549616:0:16287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.549638:0:16287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd040030c00, rc 0) 00000100:00100000:2.0:1788836403.549712:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+8:14504:x1875730518632704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5081us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.549721:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788836403.553444:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.553599:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632832 00000100:00100000:0.0:1788836403.553611:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632832 00010000:00010000:0.0:1788836403.553653:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.553698:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788836403.553707:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+8:2353:x1875730518632832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836403.553722:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836403.553763:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.553778:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.553803:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a36dde/0xcb5b7bc40b90a979 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac36 expref: 8 pid: 14987 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.553819:0:14290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836403.553823:0:14290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836403.553829:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 7 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.553839:0:14290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 7 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.553878:0:14290:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 7 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.553891:0:14290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a35b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14290:1875730538536064:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788836403.553985:0:14290:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bcf47aebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836403.561626:0:14290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a35b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14290:1875730538536064:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788836403.561655:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836403.561724:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2353:x1875730518632832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 8018us (8290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836403.561734:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788836403.565227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.565329:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518632960 00000100:00100000:0.0:1788836403.565339:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518632960 00000100:00100000:0.0:1788836403.565436:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788836403.565447:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2354:x1875730518632960:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788836403.565652:0:14988:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788836403.565656:0:14988:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788836401 00002000:00010000:0.0:1788836403.565658:0:14988:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788836400 00002000:00010000:0.0:1788836403.565660:0:14988:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788836402 -> 1788836401 00002000:00010000:0.0:1788836403.565663:0:14988:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788836403.565730:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+8:2354:x1875730518632960:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 285us (512us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788836403.565738:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836403.573098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.573178:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633088 00000100:00100000:2.0:1788836403.573188:0:14985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633088 00000100:00100000:2.0:1788836403.573245:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788836403.573255:0:14985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+8:2353:x1875730518633088:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788836403.573297:0:14985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.573318:0:14985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.573382:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.573387:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836403.573392:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.573426:0:14985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.573439:0:14985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.573455:0:14985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14985:1875730538536192:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836403.573538:0:14985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836403.577891:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.577997:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633216 00000100:00100000:3.0:1788836403.578005:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633216 00010000:00010000:3.0:1788836403.578042:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 9 pid: 16287 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836403.578086:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788836403.578096:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:2353:x1875730518633216:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836403.578111:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836403.578146:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 9 pid: 16287 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.578161:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 9 pid: 16287 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.578188:0:14288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836403.578192:0:14288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788836403.578198:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.578221:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.578243:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836403.578306:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a778e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:2353:x1875730518633216:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 211us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.578314:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:0.0:1788836403.578515:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a22579/0xcb5b7bc40b90a987 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac3d expref: 8 pid: 16287 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.578531:0:14985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14985:1875730538536192:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788836403.578551:0:14985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578561:0:14985:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578568:0:14985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578591:0:14985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578600:0:14985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578615:0:14985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578622:0:14985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836403.578626:0:14985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578634:0:14985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578646:0:14985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.578654:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a98e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.578700:0:14985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2353:x1875730518633088:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 5447us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836403.578708:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788836403.583056:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.583140:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633472 00000100:00100000:2.0:1788836403.583150:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633472 00000100:00100000:2.0:1788836403.583214:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788836403.583223:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:14504:x1875730518633472:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788836403.583300:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583317:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583333:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583608:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583620:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 15 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583629:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583663:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 15 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.583676:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 15 pid: 14305 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.583690:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538536320:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788836403.583901:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836403.588674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.590041:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633600 00000100:00100000:3.0:1788836403.590054:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633600 00010000:00010000:3.0:1788836403.590099:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 16 pid: 14305 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836403.590145:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788836403.590156:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:2353:x1875730518633600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836403.590170:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836403.590177:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 16 pid: 14305 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.590201:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 16 pid: 14305 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.590224:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:3.0:1788836403.590230:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.590239:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.590260:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836403.590279:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836403.590379:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:2353:x1875730518633600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 225us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.590387:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:2.0:1788836403.592897:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217ca00/0xcb5b7bc40b90a964 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac28 expref: 15 pid: 14305 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.592922:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538536320:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788836403.592945:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.592956:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.593092:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836403.593294:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788836403.593585:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788836403.593631:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788836403.593728:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14304:1875730538536448:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836403.593833:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836403.593870:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836403.596142:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538536448 00000100:00100000:3.0:1788836403.596156:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538536448 00000100:00100000:3.0:1788836403.596221:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836403.596232:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1875730538536448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788836403.596405:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14304:x1875730538536448:12345-0@lo:1000:mdt00_001.0 Request processed in 175us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836403.596413:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836403.596646:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14304:1875730538536448:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788836403.597340:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788836403.597632:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14304:1875730538536576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788836403.597680:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836403.597722:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836403.597779:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538536576 00000100:00100000:1.0:1788836403.597787:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538536576 00000100:00100000:1.0:1788836403.597934:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836403.597944:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14304:x1875730538536576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788836403.598108:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14304:x1875730538536576:12345-0@lo:1000:mdt00_001.0 Request processed in 165us (426us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788836403.598115:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836403.598185:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14304:1875730538536576:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788836403.598217:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598227:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598234:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598241:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3600 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.598245:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598252:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598279:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:2.0:1788836403.598281:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836403.598286:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598292:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a99c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598321:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598327:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598333:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598337:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978b400 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:2.0:1788836403.598340:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598377:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598385:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:2.0:1788836403.598388:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836403.598394:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598405:0:14304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598422:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.598449:0:14304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd040031800/0xcb5b7bc40b90a8fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xb59b48549316ac0c expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.598461:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079796300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538536704:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788836403.598530:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9bd07980cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836403.601518:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079796300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14304:1875730538536704:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788836403.601549:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.601559:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07978b400/0xcb5b7bc40b90a8f4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836403.604282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.604401:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633728 00000100:00100000:2.0:1788836403.604411:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633728 00000100:00100000:2.0:1788836403.604466:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788836403.604476:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd052735c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:14503:x1875730518633728:12345-192.168.203.52@tcp:49:dd.0 00000100:00100000:2.0:1788836403.604607:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd052735c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+19:14503:x1875730518633728:12345-192.168.203.52@tcp:49:dd.0 Request processed in 132us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836403.604615:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:0.0:1788836403.605868:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605889:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605901:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605927:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605934:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605941:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.605947:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836403.605952:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606042:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606055:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:0.0:1788836403.606058:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836403.606062:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606069:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd08217c000/0xcb5b7bc40b90a9a3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606084:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606090:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606096:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606107:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2200 already unused, calling callback (ffffffffc1fd64f0) 00010000:00010000:0.0:1788836403.606110:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606116:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606125:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd04506a700) 00010000:00010000:0.0:1788836403.606127:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836403.606130:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.606136:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb2200/0xcb5b7bc40b90a995 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836403.606434:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:14504:x1875730518633472:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 23207us (23382us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788836403.606443:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000020:00080000:0.0:1788836403.606447:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788836403.607464:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836403.607470:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836403.607501:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836403.607507:0:14336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788836403.615133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.618536:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518633984 00000100:00100000:2.0:1788836403.618551:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518633984 00000100:00100000:2.0:1788836403.618687:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788836403.618699:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:14504:x1875730518633984:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788836403.619407:0:14306:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788836403.619510:0:14306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788836403.619554:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619570:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619581:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619589:0:14306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619595:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619601:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.619618:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788836403.619715:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+20:14504:x1875730518633984:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1016us (4591us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788836403.619723:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000020:00080000:2.0:1788836403.619728:0:14306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788836403.619791:0:14291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836403.619798:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.619805:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3600 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836403.619809:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.619818:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.619841:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd04506a200) 00010000:00010000:0.0:1788836403.619844:0:14291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788836403.619848:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.619855:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd07efb3600/0xcb5b7bc40b90a9aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.619866:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836403.619868:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836403.619869:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836403.794047:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836403.794096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836403.794423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.794447:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634112 00000100:00100000:0.0:1788836403.794457:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634112 00000100:00100000:1.0:1788836403.794458:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788836403.794510:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634240 00000100:00100000:0.0:1788836403.794514:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634240 00000100:00100000:0.0:1788836403.794530:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634368 00000100:00100000:0.0:1788836403.794532:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634368 00000100:00100000:0.0:1788836403.794544:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634496 00000100:00100000:0.0:1788836403.794546:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634496 00000100:00100000:0.0:1788836403.794563:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788836403.794572:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+10:2355:x1875730518634112:12345-192.168.203.52@tcp:4:dd.0 00002000:00010000:0.0:1788836403.794624:0:14992:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f7a31, atime: 0x6a9f7a30, ctime: 0x6a9f7a31, blocks: 0x1 00010000:00010000:0.0:1788836403.794633:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.794649:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788836403.794654:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836403.794660:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836403.794701:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836403.798028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836403.798074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788836403.798211:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836403.798230:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788836403.798581:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634624 00000100:00100000:1.0:1788836403.798591:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634624 00000100:00100000:1.0:1788836403.798639:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788836403.798647:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634752 00000100:00100000:1.0:1788836403.798650:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634752 00000100:00100000:2.0:1788836403.800545:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836403.800563:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+13:2355:x1875730518634240:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836403.800606:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.800632:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.800637:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.800644:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.800658:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836403.825687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836403.826069:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788836403.826083:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788836403.826482:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518634880 00000100:00100000:0.0:1788836403.826492:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518634880 00000100:00100000:0.0:1788836403.827751:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788836403.828037:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788836403.828053:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635008 00000100:00100000:1.0:1788836403.828060:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635008 00000100:00100000:2.0:1788836403.829804:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788836403.829825:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:2355:x1875730518634368:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836403.829868:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.829887:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.829891:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.829898:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.829914:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.920603:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788836403.953113:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1788836403.953149:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1788836403.953162:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1788836403.954526:0:14992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788836403.954535:0:14992:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788836401 -> 1788836402 00002000:00010000:2.0:1788836403.954539:0:14992:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788836401 -> 1788836402 00002000:00010000:2.0:1788836403.954557:0:14992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788836403.954576:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954593:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954604:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954612:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd08217c000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836403.954619:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954630:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954657:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954666:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d61ab4/0xcb5b7bc40b90a9b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836403.954795:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+18:2355:x1875730518634112:12345-192.168.203.52@tcp:4:dd.0 Request processed in 160217us (160750us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788836403.954808:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788836403.954854:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788836403.954868:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+17:2355:x1875730518634496:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836403.954920:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954935:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788836403.954940:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836403.954948:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836403.954974:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836404.007707:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788836404.007770:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788836404.007836:0:16536:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1788836404.007840:0:16536:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:2.0:1788836404.007948:0:16536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008087:0:16536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008099:0:16536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008100:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008109:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008117:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008118:0:16536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2e00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836404.008124:0:16536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008144:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2400 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836404.008147:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008148:0:16536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008155:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008180:0:16536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008180:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008190:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e249e566/0xcb5b7bc40b90a9bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.008190:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ba8c6f4/0xcb5b7bc40b90a9b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836404.008299:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:2355:x1875730518634368:12345-192.168.203.52@tcp:4:dd.0 Request processed in 178475us (213869us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788836404.008299:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+14:2355:x1875730518634240:12345-192.168.203.52@tcp:4:dd.0 Request processed in 207735us (214195us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788836404.008310:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788836404.008314:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788836404.008390:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788836404.008412:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2355:x1875730518634624:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836404.008518:0:16536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008533:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836404.008538:0:16536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836404.008545:0:16536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.008558:0:16536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836404.009168:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836404.009193:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2355:x1875730518634752:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:1.0:1788836404.009215:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.009224:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836404.009227:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836404.009231:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.009251:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836404.011125:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788836404.096918:0:14992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1788836404.096933:0:14992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788836404.096955:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.096980:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.096989:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.096996:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb2200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:2.0:1788836404.097002:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.097011:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.097037:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.097045:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a37bf9/0xcb5b7bc40b90a9c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836404.097231:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+17:2355:x1875730518634496:12345-192.168.203.52@tcp:4:dd.0 Request processed in 142358us (302764us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788836404.097263:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788836404.097304:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788836404.097318:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+16:2356:x1875730518634880:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1788836404.097408:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.097430:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836404.097435:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836404.097444:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836404.097458:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836404.097599:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1788836404.140028:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1788836404.140205:0:16535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788836404.140211:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788836404.140230:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140245:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140263:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140271:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ac00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836404.140277:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140286:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140313:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140321:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e01cdf/0xcb5b7bc40b90a9d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836404.140501:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+12:2355:x1875730518634752:12345-192.168.203.52@tcp:4:dd.0 Request processed in 131317us (342419us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788836404.140514:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788836404.140555:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788836404.140570:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+11:2356:x1875730518635008:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:1.0:1788836404.140614:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140628:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836404.140633:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836404.140640:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.140655:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.144908:0:16536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.144934:0:16536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.144943:0:16536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.144950:0:16536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3200 already unused, calling callback (ffffffffc1590350) 00010000:00010000:0.0:1788836404.144966:0:16536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.144977:0:16536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.145002:0:16536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836404.145011:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062a7c54f/0xcb5b7bc40b90a9cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836404.145320:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+11:2355:x1875730518634624:12345-192.168.203.52@tcp:4:dd.0 Request processed in 136914us (347293us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788836404.145333:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000001:00080000:3.0:1788836404.203001:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788836404.203109:0:14992:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788836404.203115:0:14992:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788836404.203133:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203173:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203185:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203193:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07efb3000 already unused, calling callback (ffffffffc1590350) 00010000:00010000:3.0:1788836404.203198:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203208:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203242:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836404.203250:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036e2eb00/0xcb5b7bc40b90a9db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836404.203409:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+9:2356:x1875730518634880:12345-192.168.203.52@tcp:4:dd.0 Request processed in 106089us (377724us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788836404.203419:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00010000:1.0:1788836404.311138:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788836404.311167:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311182:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311193:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311222:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd07978ba00 already unused, calling callback (ffffffffc1590350) 00010000:00010000:1.0:1788836404.311229:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311240:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311266:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836404.311275:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f6f2336/0xcb5b7bc40b90a9e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836404.311579:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+7:2356:x1875730518635008:12345-192.168.203.52@tcp:4:dd.0 Request processed in 171005us (483838us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788836404.311590:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000001:00080000:3.0:1788836404.312235:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1788836404.945007:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836405.968579:0:14291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836406.314811:0:16575:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1788836406.608790:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836406.608822:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd04674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538536832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836406.608930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836406.609084:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538536832 00000100:00100000:1.0:1788836406.609095:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538536832 00000100:00100000:1.0:1788836406.609184:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836406.609195:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538536832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836406.609240:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788836406.609297:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875730538536832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836406.609305:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788836406.609440:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836406.609476:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788836406.609482:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd07a77ad80, transno 8589934595 00000004:00080000:3.0:1788836406.609503:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788836406.609537:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd04674e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1875730538536832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836406.610124:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538537216:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.610137:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538537088:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.610197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836406.610198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836406.610236:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836406.610243:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538537344:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.610245:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788836406.610255:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538536960:0@lo:400:kworker.0 00000100:00100000:1.0:1788836406.610271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.610394:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537216 00000100:00100000:0.0:1788836406.610401:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537216 00000100:00100000:0.0:1788836406.610439:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537344 00000100:00100000:0.0:1788836406.610442:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537344 00000100:00100000:2.0:1788836406.610456:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537088 00000100:00100000:2.0:1788836406.610460:0:14988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537088 00000100:00100000:0.0:1788836406.610464:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788836406.610471:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538537216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836406.610492:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836406.610499:0:14988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf45e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538537088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836406.620481:0:14303:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836406.620485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836406.620498:0:14303:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788836406.620547:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836406.620555:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836406.620592:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538537472:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.620667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836406.620714:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875730538537216:12345-0@lo:400:kworker.0 Request processed in 10240us (10515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.620721:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538536960 00000100:00100000:0.0:1788836406.620726:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836406.620730:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538536960 00000100:00100000:0.0:1788836406.620757:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537472 00000100:00100000:0.0:1788836406.620759:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537472 00000100:00100000:3.0:1788836406.620777:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788836406.620782:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836406.620785:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3303:x1875730538536960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836406.620788:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538537344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.620853:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8cc5c45-b703-4cf0-83fd-6722cde04691+19:3303:x1875730538536960:12345-0@lo:400:kworker.0 Request processed in 67us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.620860:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788836406.620892:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788836406.620896:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd04674df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875730538537344:12345-0@lo:400:kworker.0 Request processed in 108us (10626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.620899:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788836406.620903:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836406.620906:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538537472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788836406.620918:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836406.620934:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875730538537472:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836406.620960:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836406.621711:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e8cc5c45-b703-4cf0-83fd-6722cde04691:3303:1875730538536960:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.621736:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1875730538537472:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.621870:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1875730538537344:0@lo:400:kworker.0 00000100:00100000:3.0:1788836406.621885:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bcf45e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875730538537216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836406.623517:0:14988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf45e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538537088:12345-0@lo:400:kworker.0 Request processed in 13005us (13310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836406.623536:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836406.623674:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd07a77ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538537088:0@lo:400:kworker.0 00010000:00010000:2.0:1788836406.993627:0:16002:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836407.121055:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9bd079796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538537600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836407.121146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836407.123510:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730538537600 00000100:00100000:1.0:1788836407.123524:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730538537600 00000100:00100000:1.0:1788836407.123600:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836407.123611:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538537600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836407.123650:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788836407.127286:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875730538537600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3666us (6128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836407.127301:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836407.136191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9bd079796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1875730538537600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836407.494629:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494666:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788836407.494807:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635392 00000100:00100000:3.0:1788836407.494816:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635392 00000100:00100000:3.0:1788836407.494861:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635904 00000100:00100000:3.0:1788836407.494864:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635904 00000100:00100000:3.0:1788836407.494878:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635520 00000100:00100000:3.0:1788836407.494881:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635520 00000100:00100000:3.0:1788836407.494893:0:16287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635776 00000100:00100000:3.0:1788836407.494895:0:16287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635776 00000100:00100000:3.0:1788836407.494911:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836407.494920:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2355:x1875730518635392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495000:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2355:x1875730518635392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495007:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788836407.495032:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788836407.495038:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2355:x1875730518635904:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495065:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2355:x1875730518635904:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495070:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788836407.495081:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836407.495086:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2355:x1875730518635520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495107:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+5:2355:x1875730518635520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495113:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788836407.495123:0:16287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836407.495129:0:16287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2355:x1875730518635776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495148:0:16287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b72b3e-8a8e-455d-8604-5896fa644ca9+5:2355:x1875730518635776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495155:0:16287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788836407.495172:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635648 00000100:00100000:3.0:1788836407.495176:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635648 00000100:00100000:3.0:1788836407.495203:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635264 00000100:00100000:3.0:1788836407.495206:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635264 00000100:00100000:3.0:1788836407.495225:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836407.495232:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2355:x1875730518635648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495261:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b72b3e-8a8e-455d-8604-5896fa644ca9+6:2355:x1875730518635648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495267:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788836407.495286:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788836407.495291:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+20:2355:x1875730518635264:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788836407.495317:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd07ad03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7edd307d-edf6-4ac4-b35d-c4f7b39c8b6d+20:2355:x1875730518635264:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836407.495323:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00080000:0.0:1788836407.495645:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836407.495650:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836407.495652:0:14299:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836407.496643:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518635136 00000100:00100000:1.0:1788836407.496653:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518635136 00000100:00100000:1.0:1788836407.496766:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788836407.496776:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bcf44af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2355:x1875730518635136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788836407.496826:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bcf44af2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33da8487-9547-4be0-bbdf-a73d9371b5ba+13:2355:x1875730518635136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836407.496833:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 Debug log: 29221 lines, 29221 kept, 0 dropped, 0 bad.